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are  given  comparing  the  techniques  using  bit  rates  from  0,25  to  1.5  bits/pel. 
The  effects  of  noise  are  considered  and  both  quantitative  and  qualitative 
evaluations  are  given. 
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Research  Associate,  and  Mr.  George  Papacostas,  Research  Associate.  Captain 
Jack  Cole  from  WPAFB  was  the  Project  Monitor. 
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SUMMARY 


This  report  summarizes  the  results  obtained  on  data  compression  techniques 
opplicable  for  Remote  Piloted  Vehicles  (RPV)  under  Contract  No.  F33615-73-C-1233. 

During  the  first  year  of  this  contract  investigations  were  conducted  on  in- 
terframe  redundancy  techniques.  Algorithms  are  developed  to  account  for  motion 
in  frame-to-fromo  aerial  photographs  resulting  in  largo  bit  reduction  ratios 
providing  that  the  various  parameters  of  the  missions  such  as  altitude,  velocity 
vector,  fields  of  visions  of  the  cameras,  etc.  are  known  accurately.  Differen- 
tial encoding  is  used  to  further  reduce  the  bandwidth.  Sensitivity  to  the 
various  mission  parameters  are  investigated  using  computer  simulations.  Although 
the  interframe  techniques  require  relatively  complex  instrumentation  for  RPVs, 
the  techniques  can  be  used  for  s^ntthetic  frame  generation  at  the  ground  station. 

Intraframe  techniques  suitable  for  the  RPV  mission  including  two-dimensional 
transform  techniques  and  hybrid  coding  schemes  are  investigated  and  evaluated, 
both  in  the  mean-squared-orror  sense  and  subjectively.  It  is  shown  that  hybrid 
scheme  using  the  Hadomard  transform  in  one  .spatial  direction  and  PPCM  in  the 
other  performs  at  least  equivalent  and  most  of  the  time  superior  to  the  two- 
dimensional  transform  schemes.  Due  to  the  simplicity  of  the  hybrid  scheme, 
this  may  be  advantageous  ♦■r  practical  implementations. 

It  is  shown  that  the  hybrid  scheme  is  more  sensitive  to  channel  noise; 
however,  by  optimization  and  initialization  it  con  be  made  to  perform  ps  well 
as  the  transform  scheme. 

An  adaptive  scheme  is  proposed  and  evaluoted  which  shows  increased  resolu- 
tion In  regions  of  high  activity  within  the  picture. 

Several  different  error  criteria  were  investigated.  Mean-djrivative- 
squored-error  tends  to  be  more  correlated  with  subjective  evaluations. 

Important  charactorist..  "‘.s  and  performance  indices  sovera’  data  compression 
techniques  applicable  for  the  RPV  mission  are  given  in  tabular  form. 
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20  coefficients  retained.  0.55469  bits/pelv 
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.5.4.26. 

Two-dimensional  Hadamard  ti'unsform  with  zonal  filtering 
and  (idnptivo  differential  encoding  on  8 coefficients. 

12  retained  coefficients.  0.5  lilts/pel. 
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5.4.27. 

Two-dimensional  transform  with  zonal  filtcrinj,  and  adaptive 
DPCM.  24  letalned  coefficients.  8 adaptive  coefficients, 
1.0  b’ V s/pel. 
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5.4.28. 

Two-dlmon.sioiifil  fl.idyma-d  transform  with  zotiai  filtering 
and  di rfcrcntiiil  encoding,  11  netaliud  coefficients. 

11  adaptive  coefficients.  2 bit.s/diff,  Average  bh 
os.signment;  1,0625  bit.s/pcl. 
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riG.  A i 

Histogram  of  Ti'iuibform  Coefficient  H Using  One- 
Dimensional  Hiulnmni'd  Transform  (Block  Site  1x32], 

VnriUMCc  =•  3473.328. 

304 

A-2 

Histogram  of  Transform  Coefficient  #4  Using  One- 
Dimen.sional  ilaJamnrd  Transform  (Block  Site  1x32], 

Variance  « 47.0241. 
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A-3 

Histogram  of  Transform  Coefficient  H7  Using  One- 
Dimensional  Hadamard  Transform  (Block  Size  1x32), 

Variance  « 31.8469, 
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A-4 

Histogram  of  Transform  Coefficient  WlO  Using  One- 
Dimensional  Hadamard  Transform  (Block.  Size  1x32), 

Varieince  " 7. 7750. 
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A-r. 

Histogram  of  the  Difference  of  the  One-Dimensional 
Hadamard  Transform  Coefficient  (Block  Size  1x32), 

Variance  « 127.214. 
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A-() 

Histogram  of  the  Difforonce  of  the  One-Dimensional 
Hadamnrd  Transform  Coefficient  H (Block  Size  1x32), 

Variance  n 17,6121, 
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A-:' 

llistogr-tm  of  the  iiift'orence  of  the  One-Dimensional 
Hadnmavd  'rrnnsfonn  lioefficient.  f*7  (Mock  Si  ze  lx.3?) , 

Variance  » 10,5453, 
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A-  8 

ll.istogiam  of  the  Diffcrunco  of  the  Ono-LVlinensionpl 
Hadamard  Transform  Coefficient  HO  (Meek  Size  1x32), 

Variance  “ S.8997. 
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INTRODUCTION 

Vopu'f.  'Pvv^rs  work  ovor  n 24-iiionth  period  on  Contract 

5.’'  fiU'-73-C-.‘  '.3.  Althouali  tho  emphasis  on  the  work  tanks  listod  under  the 
jhovw  contract  wore  changed  somewhat  by  the  Drolect  Monitor  ns  outlined  in  the 
Monthly  Progress  Reports,  all  the  tasks  listed  wero  completed  during  the  contract. 
Tho  main  devlivtlona  include  rather  complete  investigations  of  methods  of  data  com- 
pressions applicable  to  Uoiiu/to-Pilotod-Vehiclos  (RPVJ , 

Chapter  II  sunvuiivi nos  the  work  performed  during  the  first  year  on  interfTn.nB 
lFr!\‘,ne-te-fram«)  techniques.  The  importatit  concepts  and  investigations  of  this 
work  ore  incLudtd  in  this  report;  however,  dotalled  doscript.ions  of  the  thoo- 
rotic.nl  imd  siiitiilatlon  results  are  given  in  the  Interim  Tochnioal  Report  on 
r,()fit;;vict  !•  .Tl  C.ir.-7.r-C-l2:i3,  June,  1974. 

Clmptor  in  glvoji  theoretical  rrsults  using  two-dimensi oiul  tranrtoriii  ond 
Hybrid  coding  tochniquos  of  data  compression.  DotBllod  roimlts  arc  givun  for 
th.j  '■wo-d Lmonslonal  llaUamard,  lUscreto  Cosine,  and  Haur  frnr,.si'orm  techniques.. 

Tho  Hybrid  coding  scliemos  using  transform-DPCM  or  DPCM-tran.si orn  techniques, 
which  are  shown  to  bo  equivalent  in  performance,  are  analyzed  usinp  the  ono- 
dLmensional  Hudomard  transform  to  remove  the  correlation  in  one  spntiul  dlroc- 
■dons.  The  above  techniques  wore  investigated  due  to  their  (ippUcabi  1 ity  in 
the  I’l’V.  The  effects  of  channel  errors  ore  nlso  investigated  tlieovotir.n.i  ly , 
Investigations  concerning  the  sv.itnbll .Ity  of  rlnv  t.iiidrl  for  norin'.  type 

pluno|(r.iphs  arc  inejuded. 

Clviptcn  IV  eontiilns  the  slt.uil.ition  vosuU.s  using  aerlul  ])hoiographs  supplle.l 
by  h'l’AFhi.  Nuinevuus  photoij! ;iphs  urt  preMnUed  lli.it  linve  been  pn.'efssvd  u.dny  the 

Reprodiietd  IroiTi 
b«>l  avelleble  copy.  Wm 
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tochr.lnueu  ('.'scrlbod  in  Cluiptev  IT  r . fUr  rntch  from  o.-Tri  to  l.ii  nro 

con'.iidf’. efi,  us  Inc;  vnrious  encodlns;  pi'occiluroii . T!io  .'.ffccts  of  chnntifT  noisi-  on 
tin;  tlirferont  process.tnt;  crhenes  .snd  optlini ;;at.lon  tcdinlquos  for  noisy  rliunnals 
fire  presenre^d.  In  addition  suvernl  torluiiques  of  poricdlc  rerettinjj  and  ei  ror 
oorrectlnfi  coding  nro  considered, 

In  Chapter  V an  adaptive  scheme  is  investigated  using  the  two-dimensional 
Hndanard  transform.  In  this  scheme  the  quantizer  is  adjusted  by  estimating  the 
standard  deviation  and  using  this  estimate  to  normalito  the  coefficients  before 
quantitation.  The  standard  deviation  is  transmitted  using  DPCM  techniques. 

Several  variations,  using  the  adaptation  algorithm  on  only  the  first  few  coeffi- 
cients nre  considered,  Simulation  ri>sult.s  are  givon  for  the  scone  of  the  "Truck", 
in  Chapter  VI  a brief  sunmary  of  the  important  results  are  given.  Table  0 gives 
in  tabular  form  the  characteristics  of  .several  methods  of  data  ccimprn.ssion 
i.'hich  may  be  useful  for  tiPV, 

An  extensive  soloction  of  l;ho  most  important  refurences  on  data  compress U'n 
U’chnlquo.T  applicable  to  the  RPV  mission  is  given.  Tlioso  references  are  grouped 
according  to  Tininsform  techniques,  different Inl  techniques,  frame- to-fr.nme 
techniques,  etc. 


CHART  F;K  1 I 


INTERFItAME  REDUCTION  FOR  RPV'S 

2 . I Introduction 

During  the  first  year  of  this  contract  it  was  decided  that  emphasis  should  be 
placed  on  possible  Interframo  data  compression  techniques  applicable  to  Remotn 
Piloted  Vehicles  iRPVs)«  assuming  one  frame  of  storage  available  on  the  RPV, 

Due  to  the  nature  of  the  RPV  mission  the  use  of  frame- to- frame  techniques  should 
allow  for  large  bandwidth  reductions,  with  of  course  Increased  complexity  due  to  the 
storage  requirements i Fig.  2.1.1.  Illustrates  the  areas  scanned  on  the  ground  by  n 
television  camera  located  on  the  vehicle  for  two  consecutive  frames.  For  this 
illustration  we  have  a.ssumed  a constant  velocity  vector  in  a horizontal  plane  at  an 

Frame  i 

Frame  i ♦ 1 


Pig.  2.1.1.  Two  Consecutive  Frames 

altitude  h above  the  ground.  The  cross-hatched  area  shown  in  Fig.  2.1.1.  represents 
the  redundant  information  In  frame  i + 1 given  from  i.  The  non-redundant  Information 
is  indirated  by  the  shaded  area.  Applying  this  technique  to  the  RPV  video  system 
should  result  in  large  bit  reductions,  rtecoiitly.  some  real  time  experiments  that  take 
advantage  of  the  frame-to- franc  correlation  In  picture-phone  applications  have  been 
conducted  at  Bell  System  Laboratories.  Earl)  experl iiu nt s using  frame  repeating 
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.c(:hnl<nn;s  [.  IH,  ll'O  show  vh;i*  s'n'iilc  '‘rai.i'V  inii  ri'd  icos  tho  ratn  of  truns- 

iiil'ision,  avoldlnf’  flicker  by  <lispl:iyinit  each  frame  .ioveral  times  liefore  rcplacittg 
it  with  n now  frame,  To  inprovc  tlio  efficiency  of  transmission,  tho  franu.'"io- 
fruffle  d) ffcroncl al  PCM  hn;>  bean  used,  this  is  slinilur  to  DPCM  except  that  tho 
signal  Vinlue  of  the  provlounly  rotonstructed  frame  is  \ised  ns  tl>e  predicted  value 
rnthor  than  tlio  previous  snmple  of  the  s,ime  frame.  It  has  been  observed  tl'.ut  only 
thosi)  elements  that  change  between  frames  are  encoded  for  transmission,  nccom- 
panlcd  by  their  respective  position  locution  codes.  This  method  of  coding  is 
referred  to  ns  conditional  replenishment  tll6l.  A different  coder  his  been 
described  by  Candy,  et.  til,  [120]  in  which  clusters  of  significant  frame  differ- 
ences aro  transmitted  using  a doublo-len5th  codu  (4-blt  and  6-bit)  for  tho  frame 
difl'eroncus  and  8-bit  addresses  for  tho  clusters,  Por  signals  containing  clU’far- 
entl'il.  qunnttsln,'!  noise,  improved  methods  ,\ro  described  by  Connor,  ct,  al.  L'lv.3] 

!n  which  till'  noisy  picture  is  segmented  Into  moving  nrons  nnd  Imckgroimd  ureas. 
Kcforcncos  [ill),  I2i,l  dosrrlln!  other  iiiothods  that  have  been  e.\perli’ien';od  with  to 
tuUv  exploit  the  high  spatial  .and  temporal  (frnme-to-f rnnie)  corrointion.  Tho 
use  of  11  fi'cme  inumory  capable  of  storing  the  oiitiro  frame  imugo  Is  practlcnl  witli 
tho  present  state  of  art.  Manasse  [ill]  has  presented  n method  which  inv?l\es 
the  use  of  high  directional  corrointion  inlieront  In  successive  samples  along  a 
scanning  lliu',  corresponding  samples  of  two  succ-essive  linen  of  tho  same  frame, 
i.iiJ  the  corrospi'iiding  samples  of  two  successive  frames,  tloccn  [llUl  has  uVudlcd 
a handwl.ilth  compression  method  utlUtlng  Interfran'O  corrclntlnn  In  whicli  the 
nffnct'i  of  iiiovenents  of  the  camera  and  of  tlic  objects  arc  eompcn.sntod , kocen 
a. Ill  Z.annletti  ru.l]  have  prcsi-nted  n simple  movement  cnmpcnsnt  1 on  procedcro 
i.iiicli  ca.i  be  ol' t Incil  b)'  illvi.llng  tho  tnnije  into  cones  and  then  transmitting 
t'l.r  each  '.one  a ilisplnccnient  vocti'r  relating  the  zone  in  a part  Iculin-  frame  to 
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A sone  In  thci  privious  frame  that  maximally  corralatcJ  with  it.  A ftame-r.o- 
frame  coding  technique  using  two-dimensional  Pouriur  transforms  has  been 
described  by  Haskell  Cl28]. 

Since  the  television  pictures  from  an  RPV  mission  contains  high  frame-to- 
frame  correlation,  the  use  of  interframe  techniques  would  seem  to  be  advantageous, 
The  remainder  of  this  chapter  describes  an  Interframa  technique  that  utilites 
measured  data,  such  as  velocity,  altitude,  horitontal  and  vertical  field  of 
vision,  depression  angle,  etc.,  to  exploit  the  high  correlation  between  succes- 
sive frames.  A prediction  algorithm  is  found  whereby  frame  1 is  predicted  from 
frame  i - 1 using  the  measured  parameters  of  the  vehicle.  The  performance  of 
the  system  is  studied  subject  to  the  mean-squared-error  criterion  of  goodness, 

In  this  chapter  we  summarize  the  work  performed  during  the  first  year  of 
Lnterfvame  techniques  and  its  application  to  RVPs.  Pot  a detailed  description 
of  the  study  the  reader  is  referred  to  the  Interim  Technical  Report  for  Contract 
F 33  615-73'C-ri33,  Video  Date  Compression  Study  For  Remote  Sensors,  June  li)74, 

2 , 2 Interframe  Technique  for  RPVs. 

Fig,  2.2,1  illustrates  the  basic  philosophy  of  the  technique.  Initially  we 
assume  one  frame  stoied  in  memoiy,  using  this  frame  as  a ruferenco  the  next  frame 
is  predicted  using  a predetermined  "prediction  algorithm".  The  pels  of  the  pre- 
dicted frame  are  then  compared  wltli  the  now  frame  and  if  no  significant  differ- 
ence Bxlr.ts,  no  picture  element  is  transmitted.  This  technique  is  repeated  so 
as  to  continuously  store  the  predicted  reference  picture  and  update  only  those 
pels  that  differ  significantly  from  the  new  frame,  Only  those  pels  required  to 
update  the  rafercnce  picture,  along  with  pc'itionai  information,  arc  transmitted, 
At  receiver,  which  is  located  on  the  ground,  the  received  Information  is  used 
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I'lg.  2.2.1,  Philosophy  of  Diitn  Compression  Scheino. 

to  update  a similar  predicted  reference  frame  which  tracks  the  one  at  the  trans- 
mitter. The  information  transmitted  contains  positional  and  intensity  informa- 
tion which  enables  the  reference  frame  to  be  correctly  updated. 

Fig.  2.2.2  shows  a block  diagram  of  one  possible  implementation  of  the 
transmitter  portion  of  the  system.  There  are  of  course  other  variation,s  which 
can  be  made,  for  example  one  could  omit  the  B-bit  analog-to-digitcl  converter  and 
insert  a digltal-to-analog  converter  just  before  the  subtracter.  Depending  upon 
which  way  the  system  is  Implemented  the  differential  quantizer  would  have  a 
different  Impleinentot  1cm , For  illustration  of  ilie  system  operation  we  will  assume 
the  configuration  shown  In  Fig,  2.2.2, 

In  operation  the  transmit  to v is  assumed  to  liave  n roferenco  frame  in  memory. 
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Using  this  reference  frame  the  predictor  is  programmed  so  as  to  predict  the  loca- 
tion and  Intensity  value  of  an  incoming  pel.  This  Intensity  value  of  the  pre- 
dicted pel  and  its  location  in  the  new  frame  is  determined  by  a predetermined 
prediction  algorithm  using  measured  vehicle  data  such  as  velocity,  altitude,  etc. 
This  predicted  value  is  compared  with  the  new  information  in  the  subtracter 
circuit  which  yields  an  intensity  difference  signal.  The  difference  signal  is 
quantized  using  a differential  quantizer.  During  each  sample  period,  the 
threshold  control  logic  makes  a decision  depending  upon  the  absolute  magnitude 
of  the  difference  signal,  If  the  difference  signal  magnitude  is  considered  to 
be  insignificant,  the  predicted  value  is  used  to  update  the  reference  frame 
memory.  If  a significant  difference  between  the  predicted  and  the  actual  picture 
element  occurs,  the  output  of  the  control  logic  operates  a selector  switch  which 
strobes  the  output  of  the  adder  into  the  memory.  In  addition  to  updating  the 
memory  the  control  logic  also  causes  the  quantized  difference  signal,  accompanied 
by  its  corresponding  address,  to  be  stored  in  a buffer,  The  buffer  store  is  used 
to  match  the  random  updating  rate  to  the  constant  bit  rate  of  the  transmission 
channel , 

The  system  .shown  in  Fig.  2.2.2  can  easily  be  modified  so  a.s  to  exploit  both 
intraframe  and  Intorframe  correlation.  Such  a system  is  shown  in  Fig.  2.2.3. 

The  operation  is  basically  the  same  as  the  interframe  Dl’CM  system  with  the  excep- 
tions that  the  Inputs  to  the  subtracter  are  ths  differences  of  two  successive 
samples  of  the  input  signal  and  the  predicted  aipnal  respectively. 

Delay  lines  A and  B delay  the  Incoming  signal  snmpie  and  the  reference 
sample  respectively.  The  subtracters  A and  B compute  the  actual  sample-delayed 
and  the  predicted  sample-delayed  difference  respectively.  These  delayed  differ- 
ence signals  are  compared  using  the  differential  suhtrnctor . 

In  both  systems,  the  inputs  to  the  adder  are  the  prodicted  signal  value  and 
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Flj>.  2.J.3.  Infrct’rame-l'PC.M- IiitorftMme-ni'r.M 
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Receiver 


the  output  of  the  differential  quantiser, 

A buffer  may  be  employed  at  the  receiver  a?  shown  in  Fig.  2.2.4  to  store  the 
received  picture  information  until  it  can  be  strobed  in  proper  time  sequence  into 
the  receiver's  adder  circuit.  A transfer  of  new  information  from  the  buffer  to 
the  adder  is  accomplished  whenever  the  output  of  the  picture  format  address  gen- 
erator is  in  agreement  with  the  address  information  of  the  picture  element  to' be 
read  from  the  buffer.  This  agreement  is  dotermined  by  the  address  comparison 
circuit  which  operates  a selector  switch  enabling  the  new  information  to  update 
the  receiver's  frame  memory.  When  the  addresses  do  not  coincide  the  predicted 
value  is  used  to  update  the  receiver's  frame  memory.  After  this  occurs,  the 
buffer  read  out  then  advances  to  the  next  element.  After  each  frame  time,  the 
picture  information  stored  in  the  receiver's  memory  is  matched  to  the  trans- 
mitter's stored  reference  picture. 

The  information  stored  in  the  frame  memory  is  decoded  to  recover  the  video 
information  for  visual  display. 

2.5  Geometry  of  the  System 

In  order  for  the  predictor  to  accurately  predict  the  intensity  level  of  a 
pel  in  frame  i + 1,  from  frame  i,  it  is  necessary  to  account  for  the  movement 
of  each  pel  from  one  frame  to  another.  This  is  illustrated  in  Fig.  2.3.1  where 

we  Illustrate  the  typical  movement  of  a point  P'Cx^d'j)  cri  'the  screen  of  the 

camera,  which  is  the  Image  of  polng  P(x,y)  on  the  ground.  The  point  P'(x,y)  in 

frame  i moves  to  P"(x,,y.,)  in  frame  i + 1 due  to  motion  of  the  vehicle.  Based 

le 

on  the  coordinates  (Xj.y^J,  the  new  coordinates  (X2»y,}  can  be  estimated  using 
mensuroments  of  the  vehicle  dynamics  and  known  characteristics  of  the  optical 
system,  It  should  be  realized  that  some  points  will  move  out  of  the  new  frame 
and  become  distorted,  while  others  will  appear  that  cannot  be  predicted  from 
the  previous  frame. 
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In  ordor  to  determine  the  prediction  algorithm,  the  geometry  of  the  ayatem  must 
be  investigated.  Assuming  the  vehicle  at  point  0 at  some  instant  of  time,  the  area 
scanned  on  the  ground  is  an  isolate  trapezoid  whose  dimensions  depend  on  the  altitude 
h of  the  vehicle,  the  horizontal  and  vertical  fields  of  vision  of  the  camera,  2a^  and 
respectively  and  the  depression  angle  0^  of  the  camera  position.  This  is  illus- 
trated in  Pig.  2.3.2. 

The  dimension.s  of  the  trapezoid  shown  in  Fig.  2.3.3  can  bo  calculated  in  terms  of 
h,  Uq,  Pjj  and  0 where  0 is  o new  angle  defined  by 


0 • 90°  . 0 

0 


Fig.  2.3.3.  nimensLons  of  the  Scanned  Area. 

From  geometrical  considerations  the  following  can  be  doturmined  (see  Interim 
Technical  Report,  .June  1971  fer  (letallal; 

3l3  « tin'*  (sin  3y(2/rv:u'i  <•  ) (2, .1.1) 


13 


(2.3.2) 


m ■ OM  tan  » h sec  6 tan 

0 0 

n ■ ON  tan  ■ h sec  (9  * 2fJ)  tan  (2.3.3) 

and 

(tan  a ) (sin  (9  *3  ) ) 

tan  a • (2.3,4) 

cos  S 

It  Is  seen  In  Pig.  2.3.4  that  the  scanned  trapezoidal  area  ABC!)  on  the  ground  1:; 
projected  on  the  screen  of  the  camera  system  as  the  rectangle  A'B'C'D',  We  can  ob- 
serve that  within  the  scanned  area,  any  Una  parallel  to  Una  AB  will  be  projected 
as  a horizontal  lino  on  the  sereeni  and  any  line  that  passes  through  point  R will 
appear  as  ii  vertical  Una  on  the  screen, 

These  observations  are  used  to  derive  a relation  between  the  coordinates  (bjtbj) 
of  a point  P located  within  the  scanned  area  on  the  ground  and  its  projected  imoge 
coordinates  (x,y)  on  the  screen. 

T , Horizontal  and  Vertical  Positions 

Referring  to  Fig.  2.3,4,  it  is  seen  that  the  projected  images  of  points  ^(bpbj) 
and  Pj(MPj,c;M)  have  the  same  horizonril  coordinate  on  the  screen,  since  the  three 
points  R,P  and  P^  are  collncar.  The  relation  between  and  bj  and  Is  obtained 
consldaring  tho  plane  which  contains  lines  AB  and  OM  as  shown  in  Flj’,  2.3.S. 

It  is  soon  from  Fig.  2.3.5  that  the  algebraic  length  M'Pj  is  the  horizontal 
coordinate  of  the  projected  image  of  point  Pj  or  P on  the  ground,  namely  x^. 

Using  geometric  relationships  it  is  shown  that  the  relation  between  the 
horizontal  coordinate  of  the  projected  image  P'  on  the  screen  corresponding 
to  coordinate  bj  and  b,  of  a point  on  the  ground  l.s 
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Fig,  2.3.5,  Diugi'ara  of  the  Horltontnl  Position  of  on  Image. 


X,  - u ' uj 

^ R"cV8‘T«“-BT”F2“slTT^~gf  (2.3,5a) 

whore  a is  defined  as  the  distance  from  the  screen  to  the  lenso. 

In  similar  manner  using  a plaiin  in  the  r.y  directions,  it  cun  be  shown  that  the 
relation  between  tl\o  vertical  position  ,Vj  on  the  screen  nnd  the  coordinates  bj  and  b, 

a[bj  - h tan  -S) J 

y „ i (2, 3, 5b) 

h + b,,  tan  (0  -6) 

Having  obtained  the  position  coordinates  (.Vj./j)  of  u point  I”  In  terms  of  its 
corresponding  point  on  tlie  ground,  with  coordinates  (b^b^)  and  assuming  Knowledge  of 


ths  prastnt  position  of  cho  vehicle's  camera,  i.o.  the  altitude  of  the  aircraft,  the 
horizontal  and  vertical  fields  of  vision,  the  depression  ani(le  of  the  camera  and  the 
perpendicular  distance  from  the  camera's  loose  position  to  the  screen;  the  next  stop 
is  to  derive  an  analytical  expression  of  the  displacement  in  position  of  a poi,u 
P'(X|,y^)  duo  to  the  motion  of  tho  aircraft. 

Consider  a point  PCb^ib^)  within  the  scanned  area  on  the  ground  with  its  image 
on  the  screen,  due  to  the  motion  of  the  aircraft  the  point  I",  after  some 
frome  time  T£,  will  move  to  P"(X2iy2)>  position  (X2.y2^  is  related  to  the 

original  position  (x^.y^)  which  depends  on  the  attitude  of  the  flight  and  other  para- 
meters such  as  altitude,  aircraft  velocity,  depression  angle  of  the  camera,  otc. 

This  investigation  will  include  two  modes  of  flight  (i)  Steady  Straight  Flight, 
and  (T)  Horisontal  Circling  Flight, 

In  either  case  it  Is  assumed  that  the  camera  attached  to  the  aircraft  has  been 
stubiUted  vertically  ns  well  us  horliontnlly  und  the  depression  angle  is  kept  un- 
changed regardless  of  the  aircraft  flight  attitudes. 

(1 ) Steady  Straight  Flight 

A straight  flight  1s  defined  us  the  motion  of  an  aircraft  in  direction  parallel 
to  its  plane  of  symmetry.  Generally,  the  direction  of  motion  is  inclined  upwards  or 
downwards  by  an  angle  of  Inclination. 

Tho  horizontal  and  vertical  position  displacement  of  an  image  will  be  investi- 
gated and  the  new  projected  position  coordinates  (Xjtl'j)  on  the  screen  of  a point 
P on  the  ground  in  the  new  frame  will  be  derived  as  functions  of  points  P'(x^,yj) 
in  tho  previous  frame.  These  expressions  will  be  used  in  the  prediction  algorithm 
to  determine  the  positions. 


We  assume  th-at  the  iiircraft  Is  ut  position  0 orlitlnally  and  It  moves  to  position 
O^,  as  seen  In  Pli!.  2.3.6  after  some  frame  time  T^.  The  velocity  vector  V of  the 
aircraft  ot  any  instance  is; 

•s 

V ■ V 9 ♦ V i 

2 

where  ^ and.  2 are  unit  vectors  in  the  Y-  and  Z-coordlnato  of  the  .ground  rcfetonce 
coordination  aystem,  respectively. 

Reforrinit  to  Fig.  2.3.4,  when  the  aircraft  was  at  0,  the  image  of  a point  P(bj,b2) 
pruje.  rf'  i on  the  screen  was  P'(Xj,yj)  and  the  relation  between  the  vertical  coordinate 
y^  and  (b|^,b.,3  la  expressed  using  (2.3.5b)  which  is  presented  below  for  convenience. 

bj  , yj  + a.ten(8  -6) 

^ a - yj.tan  (9  -8) 

After  some  time  interval  T^.,  the  aircraft  moves  forward  a distance  y i v^.T^ 
and  upward  or  downw.ird  a distance  i a v,.Tj.  depending  upon  the  direction  of  Inclination. 
Fig.  2.3.6  shows  nn  upward  distance  t,  Die  aircroft  is  now  at  the  altitude  of  (h  + z) 
and  is  closer  to  point  1’^  by  a distance  y.  The  new  reference  coordinate  system 
on  the  ground  c.m  be  con.sldered  ns  a result  of  translating  the  original  reference 
coordinate  system  ZY  a distance  y In  the  Y-dlrection, 

With  1'ef.pect  to  the  row  reference  coordinate  system  whose  origin  is  now  at  u,, 

<■ 

thff  Y^-coordlnuto  of  point  P^  now  becot.ics  bl  where; 

■>  bi  - y (2.3.6) 

.Since  the  vertical  coordinate  of  tho  t;rw  image  P"  of  point  P,  becomes  y-,.  due 
to  tha  motion  of  the  .slrcraft  from  ptrlni  0 to  point  (i,,  the  tr, insl.it Ion  of  the  ground 
reference  coordlnute  system  origin  to  (I,  the  relation  between  tho  vertical  coordinate 
of  the  Imago  on  the  screen  and  ihe  courdiiuttc  hi  of  point  I’  with  respect  to  tho  new 
reference  coordltialc  s)stem  now  Iiov.'Hios 


bj^  (h  +2).cos(9-e)  + (bj-y)  .slnC8“5) 

The  relation  between  the  coordinate  which  is  and  its  image  on  the  screen 
namely  ^2'  obtained  with  the  aid  of  Fig.  2.3.8. 


1-1^,  ,1.3. (1.  Diagram  o 


f tht!  Horiioat.'il  Position  of  an  lm,Tw.e. 


(2.3.7) 


b|.  = ^2  * -0) 

h ♦ z a • yj.tanTo  -0) 

Using  (2. 3.5b  and  (2,3.6),  (2.3.7)  the  new  vertical  coordinate  can  be  ob- 
tained as  HI1  explicit  Tunctlon  of  its  original  verticol  position  and  the 
velocity  components  in  the  previous  frnme,  (for  mathematical  details,  see  Interim 
Technical  Report,  June  1974). 

a{h.y,.sec^(8-B)-T,[v  +v,.tan(e-0)Ha-y,  .tar(fi-S)]} 

y U, L_iLX ± (2.3.8) 

^ h.a.sec‘‘(8-0)-T^[Vy.tan(tt-B)  - Vj,][tt-y^.tan(9.0)] 

In  a similar  manner  using  Figs.  2.3.7  and  2.3.8  it  can  be  shown  that  the  new 
horizontal  coordinate  Is  given  by  (for  details  see  ITR,  June,  1974) 

,x  " ’^1*'® 

^ lia+T,.[v  . COS (0-0) -V  .sin(O-0;)Ha.cos(fl^B)-y,'.sln(«-0)]  ^ ^ . 3 , 9 ) 

I 2 y 1 

f ^ ^ Horizontal  Circling  Flight 

A second  case  of  Intere.st  Is  when  the  aircraft's  flight  path  Is  a true-bank  turn 
as  s lown  In  Fig,  2. .1.9.  We  assume  that  the  camera  is  Inertlally  stabilized  ns  pre- 
viously iiii'tUioii,-d, 

A .\ 

The  velocity  vectors  V and  arc  tangential  t^  tlie  curve  path  at  point  0 and  O2 
respev.tivo ly . With  the  knowledge  of  magnitudes  and  directions  of  the  velocity  vectors 
as  moiisurvd  by  the  alrcral’t's  Instruments,  the  distance  traveled  hy  the  aircraft  with 
respect  to  its  starting  position  can  bo  calculated  with  the  aid  of  an  air-data  com- 
puter systam  installed  in  the  aircraft.  A detailed  explanation  of  these  computa- 
tims  is  given  In  Reference  [121],  For  simplicity,  we  assume  that  after  some 
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Fig.  2.3.9.  Diagram  of  Horizontal  Circling  Flight. 

tin*;'  tp  the  horizontal  and  vertical  distances  traveled,  noted  as  d^  and  d„ 
respectively,  and  the  defined  angle  w are  known.  These  quantities  are  used  for 
computation  of  position  displacements.  A point  on  the  ground  has  its 

projected  image  point  on  the  screen  which  moves  to  P2(X2>y2^ 

time  later  due  to  the  motion  of  the  eircraft.  In  the  case  of  horizontal 
circling  flight,  the  new  position  coordinates  (X2,y2)  can  be  calculated  in 
terms  of  its  Initial  position  coordinates  (x^,yp  and  the  flight  dynamics  by 
considering  the  motion  of  the  camera  in  three  separate  phases: 

(i)  First,  the  aircraft  hypothetically  moves  from  point  0 to  0^, 
referring  to  Fig.  2.3.9,  following  a straight  flight  path  which  covers  the 
distance  00,  ■ d^  - cotw,  With  respect  to  its  initial  position  coordinates 

the  new  position  coordinates  of  the  intermediate  point  image  P^, 
namely  and  y^,  can  ba  calculated  using  the  straight  flight  vertical  and 
horizontal  displac&menC  equations  obtained  in  the  previous  part. 

(ii)  At  point  0^  the  aircraft  rotates  by  nn  angle  w in  zero  time. 
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An  exprwsslon  accounting  t'or  this  hypotheticni.  situation  will  be  ilerlvad  to  calcu- 
late the  new  position  coordinates  f.xl,',y'p  of  a point  Plj  on  the  screen,  us  the  result 
of  the  rotation  of  the  aircraft,  with  respect  to  its  previous  position  coordinates, 
namely  and  yj. 

(Hi)  Finally,  the  aircraft  is.  again  following  another  straight  flight 
puth  from  point  Qj  to  0^  which  covers  a distance  of  OjO^  ■ w,  The  final 

position  coordinates  (X2iV2)  obtained  by  using  the  equation.s  in  the  previous 
part. 

We  now  investigate  the  position  displacetAent  of  a point  P^^Cx^yp  on  the 
screen  which  is  the  image  of  a point  P(b^b2)  on  the  ground  when  the  aircraft 
is  moving  In  a curve  path  such  that  the  camera  makes  an  angle  w with  respect  to 
the  original  flight  path, 

It  is  shown  in  the  Interim  Technical  Report  (F  35  615»7.T-C*1233)  that  the 
1‘olAtions  between  the  coordinates  in  the  two  frames  for  the  case  is  gl-ven  by 

a[y , [cosw  + tan^ (8-0) ] +x I . sinw. soc (9- 0) +a ■ tan  (0'0)  (cosw-1) } 

y a , , ...  .1 — — ^ — - — — — 2 (2.3. 101 

^ y^tanfO-B)  (cosw-l)+XjSinw  sec(Q-S)tan(0-6)*  at  1 cos w. tan  (9-S)l 

a{x,.cosw  -ty, .005(9-0)  + a.sin(e-0)l} 

X a ^ i (2.3.11) 

.5inw.sin(0-B]  + yj .nin(9-0) .co5(9«a) . (cosw-1) > 

at.-3ln^(0“01  .cosw  + cos^{0-B)] 
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2 . 4 Prsdlr.tlon  .Maorithm 

With  the  results  of  thd  positional  roUtioni  for  pels  one  can  predict  the  movement 
of  redundant  pels  in  frame  i + 1 from  those  in  frame  i (redundant  pel  are  shown  by  the 
cross-hatched  area  in  Fig.  2.4,1],  Due  to  the  trapezoidal  nature  of  the  area  scanned 
on  by  the  camera  there  will  be  some  distortion  due  to  the  fact  that  a pul  in  frame  i 
represents  more  area  than  that  in  frame  i + 1.  The  prediction  algorithm  must  account 
for  this  distortion  in  addition  to  determining  the  pr'sitional  information. 


rig,  2.4,1.  The  Scanned  Area  on  the  Ground  at  Two 
Consecutive  Frame  Time 

The  frame  image  Is  assumed  to  be  spatially  sampled  and  represented  by  a square 
array  of  NxN  intensity  samples  as  illustrated  in  Fig.  2.4.2,  Each  picture  element  is 
represented  by  a discrete  function  f(l,J),  whore  f(  ) is  the  intensity  level  und  l,j 
are  the  coordinates  of  the  picture  element. 

The  entire  area  covered  by  an  Image  is  divided  Into  NxN  rectangular  elements 
which  are  labeled  accordingly.  Thus,  the  picture  element  whoso  Intensity  value 

is  is  assumed  to  be  at  the  center  of  the  ij*'^  sub-nrcii  as  .-ihown  In  Pig,  2,4.2. 
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Fig.  2,4,2.  Geomatry  of  a Plctura  Elament  on  the  Screen. 


For  every  redundant  picture  element  In  frame  1 with  coordinates  there  is 

a pel  with  coordinates  on  the  previous  frame  which  can  be  calcvilated  u.slng 

the  frame- to> frame  positional  relation  given  in  the  previou.i  section. 

th  ^ 

The  ij  predicted  intensity  value  fjlUj)  of  the  pel  Is  obtained  from  the 
inconsity  value  f^(Xj,yj)  of  the  pel  in  the  previous  frame. 

To  account  for  the  spatial  distortion  from  frame -to -frame,  two  tuohnlques  ure 

A 

used  to  specify  the  predicted  value  f_j(i,J). 

One  type  of  algorithm  Is  to  assign  the  intensity  value  of  the  nearest  position 
In  the  previous  frame  to  bo  tho  predicted  value  fjfi.j),  ui  Illustrated  In 
Fig,  l.e.,  tho  predicted  value  of  the  i>el  Is  the  Ir-tensltv  value  jf 

the  pel  whose  aub-areo  covers  the  position  (Xj.yj).  We  designate  this  as  the  uero- 
order-hold  (ZOH]  technique. 


Fig.  2. 4, 3.  nlugnuii  of  icvo-urder-tiuld  I'rcilic tlon . 
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'Ihe  predlcCcil  value  ot'  the  pel  will  be 


Ml'  r) 


12.4.1} 


Another  method  that  could  be  ueed  Is  to  linearly  inteqjolute  from  the  four 
samples  surrounding  the  position  (x^,y^).  This  is  illustrated  in  Pig.  2.4.4, 
and  is  designated  a.s  the  linear  interpolator  technique  (LI). 


Uj../,) 


Pig.  2. .1.4.  Diagram  of  IVo-Dlmonsiunal  l.ineav 
Interpolation. 

The  prodictod  value  fjCi.j)  is  calculated  by  linearly  Intorpolutlng  In  the  J> 
Jirection. 

[yi'U'-ni  (2.4.2) 

111?  error  e(l,J}  due  to  predicting  the  Ij'"*'  picture  clement  is  the  difference 
hetwoK'n  the  Incoming  signal  value  fT(l.J)  and  its  corresponding  predicted  value  f,(l,J) 

>s 

e(i.,n  - fid.))  - f^d.,)) 

It  is  seen  from  Pig.  2..1.1  that  some  picture  elements  In  frame  i + 1 on  a 
particularly  line  will  not  correspond  to  a particular  picture  element  in  frame  i. 
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To  account  for  this  sltuatioti,  tha  jjrodicted  values  of  those  picture  elements  are 
ussutned  to  be  the  values  of  the  nearest  picture  elements  that  have  correspondents 
in  the  previous  frame. 

In  rummary,  the  prediction  algorithm  must  perform  the  following  functions: 

(1)  Compute  the  position  of  the  pels  using  (2,3,8)  and  (2,3.0), 

(2)  Predict  the  intensity  level. 

Since  the  prediction  algorithm  requires  the  use  of  measurements  of  velocity, 
altitude,  heading,  etc.,  there  will  be  errors  introduced  which  will  limit  the 
accuracy  of  the  prediction)  thus,  the  amount  of  compression  that  can  be  achieved, 

A theoretical  analysis  relating  to  the  sensitivity  of  the  prediction  is 
given  in  the  Interim  Toohnical  Report  for  Contract  P 33»61.'!-73-C-1233,  June  1974, 
In  Che  simulations  described  in  the  next  section  we  introduce  random  noise  to 
account  for  the  errors  in  the  measurements. 
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'.’■5  Simulation  Rasults  (Interframe'-DPCH) 


Saveral  frames  of  a typical  RPV  mission  containing  some  fuel  tanks  were  sup- 
pliod  by  WPAPB.  However,  upon  Investigation  it  was  found  the  movement  of  fuel  tanks 
followed  no  predictable  path.  This  could  have  boon  the  result  of  several  things, 
such  ns  movemenr.  of  the  camera  during  the  mission,  etc.  Along  with  this  behavior, 
several  parameters  such  as  velocity,  altitude,  depression  angle,  horixontal  and 
vertical  fields  of  vision  were  unknown.  The  best  data  that  could  be  obtained 
regarding  the  parameters  that  were  needed  was: 

(1)  Velocity  of  200  knots. 

(2)  An  altitude  of  ISOO  feet, 

(3)  Depression  angle  of  15°. 

(4)  Horltontal  field  of  vision  10®. 

(5)  Vertical  field  of  vision  13®. 

(6)  A frame  rate  of  S per  second. 

(7)  Dimensions  of  the  frame  is  ,631"  x ,872". 

Due  to  the  fact  that  tost  of  the  above  parameters  were,  at  best,  a good  guess 
and  that  the  camera  was  apparently  continuously  moved  in  an  unpredictable  manner,  os 
evidenced  by  the  erratic  movement  of  the  targets  from  onp  frame  to  another,  the 
pictures  were  found  unusable.  In  order  to  test  the  system  a 256  by  256  portion  of 
one  of  the  pictures  containing  the  fuel  tanks  was  u.<ted  as  a frame  (frame  i)  and  the 
input  picture  (frame  i'^1)  was  generated  using  the  prediction  algorithm  described  in 
Section  2,4.  The  effect  of  a real  system  wos  simulated  by  making  the  velocity, 
altitude,  etc.,  random  variables.  This  was  done  by  adding  predetermined  amounts 
of  noise  to  the  parameters.  The  mean  values  of  the  parameters  were  assumed  to  be 
those  specified  above. 

Fig.  2,5.1  shows  a block  diagram  of  the  interframo  DPCM  simulation.  For  this 
simulation  a 256  x 256  portion  of  the  aerial  photograph,  c'^ntalning  the  fuel  tanks, 
was  used  as  the  loforence  picture.  The  new  fr'imo  Input  wns  simulated  by  using  the 
reference  frame  to  predict  the  now  frame  nnd  adding  noise  to  the  assumed  velocity, 
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Tlie  vslocity  was  assumed  to  be  a gaussian  rumlom  variable  with  u mean  equal  to  the 
true  velocity  and  variance  o^‘ . This  In  effect  implies  noise  in  the  measurement 
of  the  velocity. 

Histograihs  of  the  grey  levels  of  a portion  of  the  aerial  photograph  containing 
the  fuel  tanks,  the  simulated  pictures  and  the  difference  signals  between  the  input 
signal  and  Us  predicted  value  for  various  predetermined  values  of  standard  deviation 
assumed  for  the  aircraft  speed  are  given  in  the  Intoriiit  Technical  Report.  The;.e 
statistical  characteristics  are  summorized  in  Tablas  2.S.1  and  2.L.2, 


Average 

DEBBEEIA 

Rcfertnoa 
pie  ture 

112.3972 

2448.304 

ZOH  pradloeed 
pie  cure 

114.9017 

2113.270 

LI  predicted 
pie  ture 

114.6423 

2121.803 

Table  2.S.I.  Statistics  of  tlic  Koterence, 
ZOM  and  LI  Predicted  Pictums 


Z.O. 

.H. 

Average 

Ver ranee 

-0.34207 

196. 1364 

-0.30303 

189.R243 

-0.28219 

183.2324 

-0.27303 

lbS.0328 

•0.14900 

• 0.  13400 

• 0.  124B0 

• 0.  12226 


7 . 60037 
26.37233 
49 . 72946 
VI'  .3  926  3 


A:,  shown  ill  lii;  2.5,!,  tho  cl  i fit;  roiii  o sluncil  pcisses  thronnh  :i  threshold  lojile 
iiocwi'rk,  nnJ  those  dift'ereiue  sijjnals  wh'di  arc  grontor  than  a preset,  threshold  (T) 
are  (|uantt:od  and  transmitted. 

The  number  of  difference  signal  samples;  of  an  entire  picture  which  exceed  sioinu 
preset  threshold  Uvela  are  shown  in  Tuhlc  f'oi  various  aircraft  .speed  stondard 

devlutlotis. 


STD 

3 

STD 

s 10 

STD 

13 

STD 

20 

T 

ZOH 

L.I 

ZOH 

1..  I 

ZOH 

L.I 

ZOH 

L.I 

1 

60336 

29769 

39873 

A0939 

39308 

A6132 

38860 

A9319 

2 

3;A16 

20213 

36717 

3236A 

35831 

38777 

33033 

A28S2 

A 

S1728 

10006 

50690 

21310 

A9289 

28232 

A80A3 

33216 

8 

A 08  5 3 

3068 

39S1A 

1013,3 

378AA 

100A8 

366AS 

2076  1 

16 

23A6D 

331 

22A91 

292A 

21399 

5766 

207  10 

8381 

Table  Number  of  Dii'forence  Signals  lixcoedlng 

Thrc'thoUl  l.cvels  (Iritorframe-DI'CM) . 

Pse  dlffemicp  signal  is  assumed  to  he  normally  distributed  with  zero  mean  and 
variance  pi'cjportlona)  to  the  standard  deviation  of  the  aircraft  speed  measurement, 
fills  assumption  is  an  ap|iroxlmat  iun  of  the  actual  statistical  characteristics  of  the 
ill  f fpcence  signal  us  ohtalned  In  Taiile  d..1,2. 

With  this  ■ilmplifled  approx  Imiit  ion , a lo-lovel  non-uni  furin  quantizer  for  minltnum 
dist  Iff  lull  as  dcscribi'd  h\  Max  (ii7|  Is  nsril  tc’  ipiantizod  thi'sc  dlfformce  signals  that 
i'>ii'iid  .1  pnsi-i  thresluiM  level. 

I'he  total  error  of  the  system  i<  defined  as  the  diffctencr  between  the  Input 
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signal  to  tho  syrten.  and  tha  raconstruc ted  signal.  The  transmission  system  is  indi- 
cated In  tht  following  diagram 


Aaiunlng  noiseless  channel,  the 
aa  followst 

(1)  Mean«squared  error  (HSB)  Is 


total  systaa  error  apacificationi  are  calculated 


1.1  ‘ >■ 


N 

N 

1 

IT 

i-i 

i>l 

N-M 

M 

1 

IT 

1 1 

i«l 

i-1 

di<T 

d^>T 

(2.5.11 


where  M is  tho  number  of  difference  signals  tliat  exceed  tho  pre.iet  tluesihold  level  T. 
When  tha  difference  signal  is  considered  to  be  insignificant,  the  quuntitev  output 
Is  assumsd  to  be  taro,  thus  the  total  system  moen>3i)uared  error  can  be  rewritten  as 


N-M 

M 

1 

IT 

'I  -1^  ■ 

. Yid 

i*l 

i-l 

d^<T 

d^>T 

(:,5,2) 
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(3)  M«an*kbiolut«  •rror  (NIAB)  li 


N 

• R I (!,S.4) 

1«1 

In  «iclditlnn  to  tht  «bovt  orror  apncificntions,  wo  dtflno  tht  following  error 
.ipeciflcntlon*  thot  will  b«  colculattd  and  oboorvod  throughout  tho  oKporimont. 

(4)  T)ir»ohold  moan>oquartd  trror  (MSE^,)  1$ 

N«M 

• ra  I (2.S.5) 
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C3)  Quantization  maon'squarod  orror  CMSE^)  Is 


(6)  Tlireshold  mean-absolute  error  (MAE^)  is 

N-M 

S > ‘‘i  ■ * ^2.5.7) 

i«l 

(7}  Quantlzavlon  mean-absolute  error  CMABq) 

M 

"“q  ■ ^ 2 C2.5.»! 

1-1 

The  results  in  Table  2.5,3  indicate  that  a large  bit  savings  can  be  obtained 
provided  that  velocity  is  known  accurately.  These  results  also  indicate  that  linear 
interpolator  technique  gives  superior  results  over  th'S  zero-order-hold  technique, 

This  is  to  bn  expected  since  the  Input  frame  was  simulated  using  the  LI  technique, 
ihe  results  also  Indicate  that  the  number  of  difference  signals  which  must  be  trans- 
mitted increases  as  the  velocity  standard  deviation  increases  and  decreases  as  the 
threshold  increases;  however,  increasing  the  threshold  results  In  mo*-e  error.  Table 
2.5.'1  .shows  the  corresponding  threshold  mean-squared  en*or.  Tn-  relative  Inrge  amount 
of  error  using  the  ZOH  technique  is  to  be  expected. 

Since  it  is  the  difference  slgncl  at  the  output  of  the  threshold  logic  that  is 
quantized  and  transmitted,  the  stotlstic.nl  characteristics  of  this  signal  nre  of 
importance  and  are  given  in  Table  2.S.S,  with  threshold  levels  of  8 and  16, 

Comparing  the  statistics  given  In  Table  2,5.5  with  those  in  Table  2.5.2  it  is 
seen  that  the  difference  signal  ,it  the  output  of  the  threshold  logic  has  somewhat 
higher  variances,  as  Is  to  be  expected.  It  is  the  values  given  in  Table  2,,''i.S  that 
arc  useful  for  design  purposes. 
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Threshold  : 8 

Threah 

Jld  : 16 

STD 

Average 

Verlanse 

Average 

Ver  lance 

S 

0.873070 

149.0363 

1.939582 

416.0647 

10 

0.692972 

246.3818 

1.721252 

547.2219 

IS 

0.640642 

325.3937 

1.S3S428 

676.3428 

Table  2.S.S,  Intorframa  - DPCM.  Statistici  of  Dlft'erpnce 
Signal  at  the  Input  of  the  QuantUer  U#li\g 
Lineal  Interpolation. 

Tables  2.5.6  and  2.S.7  show  the  total  monn-sqimred  error  and  mean  absolute  error 
assuming  a nolseluss  channel  for  threshold  levels  of  8 and  16. 

2 . 6 Intrafrnmo«  DPCM- Interfrgma-DPCM  System 

An  Intrafraine’ DPCM- rntorfroino-tlPCM  system  iloscriheil  In  Chapter  II  was  simulate.', 
on  the  IBM/360  computer  and  is  Investigated  for  the  possibility  of  more  bit  savings  ns 
compared  with  the  Interframe-DPCM  version.  Fig.  2.6,1  Illustrates  the  slniulntlon 
procoduvu . 

Histograms  of  the  intrnframe  difference  signals  between  two  successive  picture 
elements  along  a scan  lino  of  the  moraory-storod  reference  picture  and  the  predicted 
Images  of  the  reference  picture  using  both  the  ZOII  and  LI  techniques  are  given  with 
Interim  Technical  Uepurl,  fable  2.6.1  summ.u  lies  the  statistical  characteristics 
of  the  Introframc  dltfiTonce  slgn.ils. 

In  this  system  it  Is  the  significant  fru.tie-to-frame  difference  of  the  corre- 
sponding ir.trafrume  differences  between  two  siri.tcslve  plcturo  elements  that  Is 
quantUed  and  transmitted. 
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Table  2.5.7-  Interfraae  - WCM.  Total  Syste*  Hean- 

.Absolute  Error  Using  Linear  Interpolation. 


■ 

Average 

Variance 

Reference 
pie  ture 

-0.223514 

1030.840 

Z OK  I'e  tedl 

picture 

-O’.  20 1945 

357. 5129 

LI«predtc  ted 
pie  ture 

-0.202053 

354 .3640 

Table  2.6  1.  Statistics  of  the  Intraframo 
Difference  Signal 


Fig.  2.6.1  illustrates  the  operation  of  the  Intraframe-interframe  DPCM  technique 
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Input 

Predicted 

|k 

1 2 N 

frame 

1 

Pig,  2.6.1.  Illustration  of  Intraframo-lnterframo-DPtlM  Technique. 
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For  an  pictura  element  of  intensity  value  t(i,.1),  a predictucl  intensity 
1% 

value  fdiJ)  is  obtained  using  the  predictive  techniques  as  described  previously, 
Assuming  that  the  input  picture  is  scanned  from  left  to  right  and  considering  a 
line  1 in  the  Input  picture,  the  first  Intraframe  difference  obtained  is 

s(i,l)  - f(l,2)  - fd.l)  C2.6.1) 

The  inrrafrtme  difference  of  the  predicted  picture  elements  corresponding 
to  fCltl)  and  f(l,2),  l.a,,  f(l,l)  and  f(i,2)  raspectivtly,  is  similarly  obtainad 

sCi.D  - f(i,2)  - f(i,l)  C2.6.2) 

The  interframe*lntraframe  difference  d(l.l)  ii  thus  the  difference  between 
s(i,l)  and  a(l,l) ,l,e. , 

d(M3  « 8(1,1)  - s(i,l)  (2.6.3) 

Substituting  (2.6.1)  and  (2.6.2)  into  (2.6.3),  we  have 
d(i,l)  . Cf(i,2)  - f(i,2)]  - Cf(i,l)  - f(i,l)] 

«i(i.l)  ■ dpp(l,2)  - dppCi.l)  (2,6.4) 

where  dpp(i,l)  and  dPF(i,2)  ere  the  interframe  (frame- to- frer*  ; differences  of 
the  1*^  and  2”**  picture  elements,  respectively. 

The  procedure  to  predict  the  difference  slg''aX  is  described  as  follows; 

First,  we  obtain  the  difference  betws.ii  the  first  inpvit  picture  element  on 
line  i and  Its  predicted  value,  i.e.,  dpp(l,l).  As  the  second  element  is  scanned, 
the  difference  dpp(i,2)  betw<;en  the  new  picture  clement  and  Its  predicted  value  Is 
obtained  and  compared  wltli  dpp(i,l).  If  their  difference  is  considered  significant 
then  the  picture  element  Is  transmitted  and  we  proceed  to  the  next  element.  If 
this  difference  Is  insignificant,  wo  lot  d(l,l)  be  lero  and  from  (.l,6,.l)  It  Is  seen 
that  dpp(l,2)  can  bo  assigned  the  value  of  dpp(i,l).  No  picture  element  Is  trans- 
mitted sines  the  present  picture  element  Intonsity  va'uc  Is  not.  slgniflcontly 
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different  from  its  predicted  value.  After  lliis  step  has  been  done,  we  proceed 
to  the  next  element  and  compute  the  corresponding  interframe  difference  dp^.(l,3) 
which  in  turn  Is  compared  with  dpp(i,2)  and  so  on,  until  the  last  picture  element 
of  line  i is  reached.  This  procedure  Is  applied  repeatedl}'  for  ever,'  line  of  the 
input  picture. 

Since  it  is  the  interframe-intraframe  difference  which  exceeds  the  threshold 
that  is  quantised  and  transmitted,  the  statistics  of  this  difference  signal  with 
respect  to  the  preset  threshold  level  are  of  importance  and  are  shown  in  Table 
2,6.2. 

Histograms  of  the  inter frame- interframe  difference  signals  are  given  in  the 
Interim  Technical  Report. 

Tablet  2,6,3,  2,6,4  and  2,6,5  show  the  results  obtained  using  the  intraframe- 
intorframc  DPCM  technique.  It  it  interesting  to  compare  these  results  with  those 
of  the  interframe  DPCM,  Comparing  the  results  of  Tables  2.S,.3  and  2,6,3,  we  see 
that  the  numbnr  of  nonredundant  pals  for  the  intraframe-interfrome  DPCM  technique 
is  somewhat  higher  then  that  of  the  interframe  technique,  Similarlly  the  results 
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T 

10 

15 

1 

41349 

4 9771 

33743 

2 

29383 

41320 

46434 

16327 

29012 

33993 

8 

3848 

16083 

22833 

16 

961 

3313 

9673 

Table  2,6.3,  Intruframo- Interframe  DPCM,  Number  of 
Picture  Hlemonts  F.xcoocUnR  o Fixed 
Threshold  Level  Uslnj'.  Lliienr  Interpolation 
Techn Ique , 
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Table  2.6.5.  lntxafraw5-OPOI-InterfTs™e-IM>OI- 

Total  Systes  Hean-Absolute  Error  Usiog 
Linear  Interpolation  Technique. 


of  Tobias  2.S.6,  2,5.7,  2.6.4  and  2.6.5  shot*  thut  there  Is  essentially  no  goln 
In  using  .lntrat'rome>lnterfram«  DPCM  over  fimjily  interfvnmvDPOM,  Such  n result 
tends  to  indicate  that  the  use  of  two  dimensional  schemes  may  not  have  much 
advantage  over  simple  one*dlmeiislonal  schemes  for  some  pictures. 

2 . 7 Summary  of  Simulation 

Prom  the  results  of  the  system  simulation,  it  is  seen  thet  a large  bit  saving 
factor  can  be  realised.  Referring  to  Tables  2.5..1  and  2.5.4,  a substantial  amount  of 
bits  can  he  saved  when  the  threshold  logic  In  either  system  is  set  at  levels  as  high 
as  8 or  16. 

Using  a 4-blt  quantiser  to  encode  the  transmitted  difference  signal  and  a 16'blt 
address  generator  to  specify  Its  position  (assuming  i 256  a 256  array)  each  element 
Is  transmitted  using  a total  of  20  bits.  The  average  number  of  bits  required  for  each 
transmitted  element  is  calculated  ns  follows: 

Blts/pel  ■ 20  X M (2.7.1) 

256  X 256 

where  M Is  the  number  of  picture  elements  which  Is  transmitted  over  the  channel, 

Uaiiij;  the  data  given  In  Tables  2,5.3  and  2.6.5,  the  average  bits  per  picture 
element  for  the  Interframe-DPCM  and  the  (ntraframe-PPCM-Interframe-DPCM  systems  ure 
obtained  using  (2.7.1)  for  various  speed  standard  deviations.  This  data  is  shown  in 
Tables  2.7.1  anu  2,7.2,  together  with  their  corvcspondlni;  total  normnllted  moan- squared 
errors  and  mean-absolute  errors. 

It  Is  seen  from  Tobies  2.7.1  end  2,7.2  that  the  Intrafreme-Dl'CM- IntoriTame-liPCM 
system  does  not  have  nny  siv.nlflcanl  udvantage  over  the  Interrrnme-PPt>1  svstem.  In 
both  systoms  there  Is  a trade-oft  between  the  total  system  normallicd  mc.in-squarcd 
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■ rror  and  th«  wnour.t  of  bit  savings  as  compared  with  the  standard  S>blt  PCM  system. 
In  view  of  the  fact  that  each  nonrodundant  elament  roquires  8-bits  to  specify 
the  horitontal  position,  8-bits  to  specify  the  vertical  position  and  4-bits  to 
specify  the  intensity  value  of  the  difference  signal,  it  la  possible  that  increased 
bit  savings  could  be  obtained  by  forcing  the  first  pel  of  each  line  to  bo  trans- 
mitted. Using  this  technique  would  require  only  8-bits  for  the  horitontal  position 
and  4-bits  for  the  intensity  of  the  difference  signal.  Although  more  pels  would 
bo  transmitted  the  net  savings  in  the  nunlsr  of  bits  required  might  bo  substantial. 
Simulations  were  performed  to  evaluate  this  type  system  and  the  results  are  shown 
in  Tables  2.7,3  and  2.7,4,  Also  shown  for  comparison  purposes  in  parenthesis  are 
the  results  obtained  using  16-bits  to  specify  the  position,  The  latter  technique 
would  have  essentially  the  same  or  slightly  bettor  error  performance  duo  to  the 
fact  that  the  first  element  of  every  line  is  assumed  nonrodundant.  Some  special 
coding  technique  would  be  required  so  that  the  recslvsr  could  properly  identify 
th«  first  pel  of  each  line. 

2 . 8 Total  System  Error  Including  Channel  Noise 

In  thie  section  we  include  the  effect  of  channel  noise  on  the  triinsmisslon 
system  and  investigsie  the  performance  of  the  Interfrtmc-DPUM  system  using  Linear 
Interpolation  technique  for  the  ilmulated  input  picture  and  the  predicted  picture, 
The  total  system  error  calculstioni  ere  based  on  the  hypothesis  that  the  system 
transmission  is  coherent  phase-shift  keying  (PSK).  A 20-bit  word  Is  transmitted 
over  the  noisy  channel  for  etch  non-redundant  picture  element.  The  16  most 
significant  bit^  carry  the  information  of  the  element  position  and  the  4 least 
significant  bits  are  the  coded  intensity  .alue  cf  the  tranimmlng  signal.  Due 
to  'ransmis.'.ton  channel  noise,  the  received  word  may  he  different  from  the  one 
that  was  transmitted.  The  error  can  occir  in  th^  position  Information  part  of  the 
Intensity  value  part  nr  both. 
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Threshold 

Vflcc  1 t.‘/ 
SbiinJ-'id 
iy>vl.ition 

1 

Pit!,  I'.M-  Pictu!  1 

1-:  fnviit 

a 

5 

.600  (1.074) 

8 

10 

1.006  (i.2Q) 

8 

)h 

2.yU!>  (5  74) 

16 

5 

.111  {,12.') 

16 

10 

.502  (.'>54) 

16 

IS 

1.103  (1.8'ib) 

Table  2.7.3.  Interframe-DPCM. 


Velo'-'  by 

Tlireahold 

Standard 

Bits  Por  Picture 

Deviation 

Element 

8 

S 

1.12  (1.7B5) 

8 

10 

2.99  (4.'t») 

8 

IS 

4.23 

16 

5 

.22.1 

16 

10 

1.02  (1.02) 

16 

IS 

I . 8/  ( " -■> 

Table  2.7.4,  Intrnfr.ime- liuorOnnio-IilVM. 


'Ilio  proh.'ihi  I Lt\  c orror  uhIiih  oohurcnt- I'SK  transinlii'i loti  lit  w;'ll  Known  to  liw 


PU  . ^ t 1 - *rt(/f  1)  „ , 

wli'.'i'i*  li  is  the  energy  ot‘  the  tTansmltted  signal  und  II  Is  the  rate  of  transmission  of 
the  sysfnm. 

1ho  rate  of  transmission  R Is  uspressud  as  the  total  luinihor  of  nits  transmitted 
over  the  channel  fur  each  picture,  l,e,, 

R . .>0  hitu/pel  ,x  M (?,8,2) 

where  M Is  the  lumiher  of  picture  eteinents  transmlttud  for  each  frame. 

Using  the  prohabi  ll t.y  of  error  In  (2.S.1)  cun  be  rewritten  ns  follows: 

Pt  <*  'j  ! I • erl'{v'|;j^  }]  (3,S,,1) 

A threshold  of  detection  Is  defined  as  follows: 

Til  • 1 • it:  (2,8,.n 

Iho  coherent -I'SS  transmission  ehannel  was  simulated  on  the  IHM/Jbi)  computer, 

Tables  .VH.l  und  2.S.2  show  the  prooulMllty  of  erior  and  the  uuinhor  of  picture 
uloineiits  In  error  (I!  i;-  the  total  otuirgy  fui  n plcturel,  I'lui  number  -jf  picture  eUnnonts 
'.III  It  .ire  1 iMtisml  t tail  tor  imcIi  tram-  Is  Kiiveil  from  the  results  of  Table  2,5,3, 

’nie  f,'i,il  S'  ti'iM  mein  s,|u.ii'i-.l  irio'':'  i i.-,  1 o i uj;  ili.imul  iiolsc  art'  shown  in  T.il'les 
s;  .iiil  J..S1  i.siio;  tlip'slio 111  levels  oi  ,s  ,in,l  1'!  respectively  together  isltli  their 
, I I ■■.poM,' I M)|  II' i se  1 '• . > iliai'iiel  lotll  'Oite,.'  iHe.lM -Sipi.ired  ,.‘IT"I';1  for  comparison. 
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2.9  Suiivnary  and  Conclusions 

The  results  of  the  simulations  have  shown  that  the  interframe  bandwidth  reduc- 
tion scheme  can  be  utilized  to  achieve  a low  average  number  of  bits  required  for 
each  picture  transmitted  to  the  receiver.  A trade-off  between  the  amount  of  band- 
width reduction  and  the  system  error  is  an  important  consideration.  The  effective- 
ness of  the  system  depends  largely  upon  the  degree  of  accuracy  of  the  instrumental 
measurements  of  the  vehicle  dynamics. 

In  this  experiment,  a 20-bit  word  is  transmitted  to  represent  each  nonredundant 
picture  element,  in  which  a total  of  16-bits  are  used  to  carry  the  address  informs - 
tloit  of  the  transmitted  signal.  This  position  bit  requlroment  may  bt  further 
reduced  by  forcing  the  first  pel  of  each  line  to  be  a nonredundant  sample.  Using 
this  technique  only  B-bits  are  required  for  the  horizontal  positional  information 
and  1-bits  for  the  grey  level  information.  A higher  reduction  in  bit  requirement 
may  be  realized  with  a total  of  12-bits  being  used  for  each  picture  element  trans- 
mitted to  thr  receiver. 

The  complexity  of  the  system  implementarior.  is  in  the  realization  of  the 
predictor  to  faithfully  predirt  the  next  picture  nnd  the  storage  required  to  store 
on')  frame.  The  system  implementation  is  further  complicated  when  the  problem  of 
optimizing  the  capacity  of  the  buffers  employed  at  both  the  trunomittcr  and  the 
receiver  is  considered  in  order  to  avoid  the  problems  of  buffer  overloading  or 
underloading,  which  can  result  in  a loss  oi  information  needed  or  a waste  in 
necessary  bandwidth  requirement  for  picture  reconstruction. 

Although  the  Interframe  techniques  described  in  this  report  requires  rather 
complex  hardware  and  software,  the  scheme  can  be  used  at  the  ground  station  for 
synth'jtU’  frnmt  generation  or  frame  replenishment..  This  would  allow  for  relative 
low  frame  raves  without  detrimental  visual  effects  on  the  observer.  The  predictor 
cl.^orlthm?,  can  easily  be  generalUed  to  include  roll  and  simulation.  It  is  the 
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conclusion  of  the  authors  that  the  prncticnbU ity  of  such  a scheme  as  described 
in  this  chapter  would  require  excessive  complexity  for  use  in  the  vehicle;  however, 
would  be  of  value  and  easily  implemented  for  synthetic  frame  generation  ut  the 
ground  station.  This  would  allow  for  relative  slow  frame  rates  without  serious 
disadvantages  of  flicker,  etc. 

There  are  several  other  possibilities  using  frame<to-frame  techniques  which 
mi^ht  be  considered,  such  as  using  Intrafraine  transform  techniques  to  first  process 
the  picture  and  then  use  differential  techniques  frame-to* frame.  Such  techniques 
would  have  an  advantage  in  that  intraframe  techniques  would  have  alreedy  compressed 
the  data;  therefore,  relieving,  somewhat,  the  memory  requirements.  In  addition 
the  use  of  differential  techniques  on  transform  coefficients  may  he  less  sensitive 
to  puramatars  such  as  the  velocity,  altitude,  etc. 

Due  to  the  relative  complex  instrumentation  required  to  Implement  these  franie- 
to  frame  techniques,  the  project  monitor  requested  we  terminste  the  emphasis  on 
t'r.nr.e'to*ffini«  methods  in  favor  of  the  more  practical  Introframe  techniques 
described  in  tho  next  chapter. 
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X , 1 Introduction 

Kecantiy  there  has  been  Increased  Interest  In  a combination  ot'  the  ortho- 
gonal trnj\s formation  techniques  and  DfCM  [83-93].  A brief  theoretical  analysis 
of  the  UFCM  and  the  transformation  techniqies  and  their  combinations,  the  Hybrid 
Coding  lochniques,  arc  presented  in  the  following  sections.  Relevant  to  tele- 
vision and  video  data  transmission,  the  processed  data  are  assumed  to  be  real 
roiidom  variables  generated  from  a soparatoly-multidirenti ■^nll  1 first  order  Markov 
process . 

Without  loss  of  generality,  these  random  variables  are  assiuned  to  have  loro 
muon  and  unity  variance. 

Ho>'  .mulytical  purpor.a,  the  porl'ori.ianccs  of  the  coding  sytitems  arc  me.nsureil 
using  tho  normalized  mean-square  enor  critetlon  which  is  muthemiicl tally  tractublo. 

.'5 ,2.1  LiPCM  and  Time  Predictive  Technique s 

Among  the  many  intruirome  data  compression  techniques  that  have  been  Investi- 
gated in  recent  years,  uue-  utiJ  two  diuicnslunul  ui  fl'erontlal  Pulse  i.ede  I'lodulatiui. 
tDPCMJ  systems  have  received  a considerable  amount  of  attention.  Tills  is  probably 
due  to  Lis  simplicity,  1-ig.  3.2,1  Illustrates  by  block  diagrojii  the  operation  of 
ii  UPC.M  encoder.  In  UPC?'  systoma  a differential  signal  e^j  Is  obtained  by  taking 
the  difforonc')  between  the  sainplo  value  ^ and  it.s  predicted  value  , 'Hie 

procitetod  v 'llu..  1 ■.  general  I,.'  ol  rained  l'>  taking  a linear  rombinatioii  of  the  pre- 
oauneil  plct'i'''  o lo.nent  s . Hie  lo'.chtlng  coefficients  In  this  linear  coiibination 
are  noitaill  ■ d • to rmlne J by  .issimiing  known  st  itionary  statistics  for  the  Image, 
ibis  prec"-.-  I illa'trntod  lor  ih-’  gi'n'i.il  t.'-e  lu  li)’,. 
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Fij.  3.2.3.  Interpolative 


'Ilie  dli‘htn<nce  sainplos  e^.  are  uncorrolated  for  caaeii  of  stationary  statis- 
tics and  tlieso  difference  samples  are  quantized  and  coded  for  transmission  over 
the  chiuinel.  'Iha  receiver  then  reconstructs  the  waveform  by  a similar  procedure 
iiii  shown  in  fiji.  3,2,1, 

iTte  efficiency  of  the  coder  not  only  depends  on  the  difference  samples 
being  uncorrt  1 atoJ  but  also  on  the  varluncof.  of  the  e|j'S‘  variances  of 

these  difl'ei'unco  signals  are  related  tu  the  number  of  samples  used  in  predicting 
U|j  and  to  ihe  relative  locations  oi  these  swnples  with  re.spoct  to  the  point 
(I, .11,  IMtlu'i'  1-,  2-  or  n-dimenslonal , cousal  and  noncausul  DPfM  systems  may  be 
used. 

The  onu*d'iiienuional  DPCM  encoder  is  frequently  preferred  because  of  Its 
(nxcroiiiu  s I iiipl  1 ci cy , An  analysis  of  UPCM  encoders  using  total  mean-squared  error 
I Liicluding  the  efforts  of  chiuuiel  errors)  as  a measure  of  fidelity  Is  given  by 
i;, small  ami  Wlnu  [UifeJ,  Results  of  this  study  indicato  that  the  uiie- dimensional 
III  CM  'incoder  gives  good  results  using  throe  bits  per  picture  element  ipelj, 

.'bhort  ri7rtl  designed  a DPtlM  codec  (coder-decoder)  which  gives  minimal  subjective 
impalrti’iit  using  four  bl tr>/]’l xel , Habib'  [?4j  evlaiuited  the  performance  of  an 
n'"'"  order  'iPCM  systems  for  N ranging  from  1 to  22  and  compared  it  to  the  perfor- 
iimniic  o(  unitary  transform  techniques.  His  results  indicate  that  a UPCM  system 
using  n third  or  higher  order  predictor  performs  superior  to  nil  transform  toch- 
uinu-'!i  when  the  system  is  optimized  for  a particular  picture;  however,  the 
t'.insfoun  li'chn:'|ue  Is  much  less  sensitive  to  variations  in  picture  statistics 
M'.an  :iio  bPt.H  syatoms.  More  recently  llahlbi  r6,T,nul  has  shown  the  relationship 
lir'iM'cn  t'K  DPiM  and  transform  coding,  A coiislJeiahlo  number  of  onrlLer  works 
un  ii'CM  hav,’  hi  I.  ie|iortod,  O'Neal  I 133 , 15',' , lb.i  I give;,  both  theoretical  and 

-,'111111,111011  i-.-Miltii  ■)'■  ]•!  ,K  c‘>‘.  I iig  '-'ill  pic  l urc; . Tht'  um*  of  one  bit  l)IT.!-i 
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or  delta  modulntion  has  been  studied  by  O'Neal  [179].  More  recently  adaptive 
data  modulation  schemes  have  been  investl)]atod.  In  adaptive  delta  modulation 
the  step  lise  Is  either  increased  nr  decreased  dependlii];  on  whether  the  modulator 
is  In  the  slope  overload  region  or  the  granular  region.  Many  algorithms  for 
increasing  or  decreasing  the  stop  ha^'c  been  Investigated.  Step  site  alteration 
schemes  con  be  either  analog  or  digital.  Analog  nr  continuous  schemes  measure 
some  property  of  the  input  signal,  such  as  the  average  slope,  and  adjust  the 
stop  size  accordingly,  Ihe  digital  methods  adjust  the  stop  size  only  at  certain 
sampling  instants  using  some  type  of  algorithm  based  on  previous  digits.  Several 
studies  using  adaptive  delta  modulation  schemes  to  transmit  speech  have  been 
reported,  References  [1B0,19SJ  give  results  for  both  analog  and  digital  compan* 
ding.  Since  the  clock  rate  required  for  theso  tci;hniques  Is  rolntively  high, 
their  usefulness  for  the  Ri'V  application  Is  questionublo,  It  is  possible  that  a 
combination  adaptive  delta  modulation  with  other  schemes  such  as  IM’tIM  might  be 
of  Importance.  In  this  case  the  adaptive  delta  modulator  would  be  used  essen' 
tlully  as  on  analug'to-digi tul  converter  and  the  output  bit  stream  would  be 
encodevi  In  some  other  iiiethod  such  ns  Ol’CM  bofoie  tronsmissioti.  'fliere  has  been 
lltt'e  reported  in  the  literature  on  such  schemes  as  applied  to  image  processing, 
Oliver  tl9^]  describes  on  adaptive  delto  modulatoi  for  pictorial  data  using  over- 
shoot compensuti on  which  operates  sat Isfnctorily  using  less  than  3 bits/plxel, 
Suvevil  other  authors  have  investigated  the  use  of  UPCM  and  delta  modulation  [197- 
2 12] . 

Recently  .Jain  [91]  and  lain  and  Angel  |1711  has  considered  DPCM  encoders 
which  lire  Inteqtiilatl  ve  in  nature  luid  Indicate  the  relationship  lietwoen  this  type 
of  coding  iinil  tr.iiuifurm  ci  ding.  Tbo  cuinpui iitionul  requ I rnmeni  s aie  shown  to  bo 
i.u.-’sldrruMy  U>s:.  fur  thi:;  coding  scheme  than  lor  irmv.lorni  cudiiij;  mul  performiuice 
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almost  equivalent.  However,  in  difforontlal  aystems  a major  concern  is  the 
sensitivity  to  noise,  which  has  not  been  e,\ploitecl  for  these  types  of  systems. 
Qtang  and  Donaldson  [173,174]  investigate  non-adaptive  DPCM  coders  over  noisy 
channels  with  and  without  error  correcting  coding  using  arbitrary  linear  predic- 
tors. Tite  signal-to-noiso  ratio  over  previous  sample  feedback  coders  is  shown 
to  increase  approximately  2,6  dB  for  noiseless  channels  and  4 dB  for  noisy 
channels,  Optimisation  of  the  predictive  coefficient  for  noisy  channels  is 
shown  to  reduce  the  sensitivity  of  SNR  to  both  variation  In  the  input  signal 
ai\d  channel  parameters  without  much  degradation  of  the  SNR  below  its  optimum 
value  for  error  free  channels. 

O'Neal  [177]  has  shown  that  DPCM  followed  by  imtropy  encoding  performs 
within  l.S  dB  of  Shannon's  rate  distortion  function,  which  bounds  the  performajice 
of  any  encoding  system  using  minimum  meon-square-errov  criterion.  In  this  study 
uniform  quontiration  is  used  with  entropy  oncodiny,  which  increases  the  comj5le> 
xity  oomowhat,  Jayant  [169]  gives  a tutorial  typo  paper  on  PCM,  DPCM  and  DM 
(delta  moduiation)  for  speech  type  signals. 

DPCM  coders  axe  still  of  considerable  interest  due  to  their  relative 
simplicity.  The  primary  disadvantage  of  differential  coders  is  their  sensitivity 
to  signal  statistics  tuid  to  channel  noise.  1 believe  that  invosiigati ons  of 
methods  to  redice  this  sensitivity  is  still  needed  and  once  salved,  would  moke 
DPCM  systems  attractive  for  use  n the  RPV  vehicle.  The  hardware  simplicities 
would  probably  make  it  a strong  contender  for  these  types  ot  applications. 

Time  predictive  techniques  generally  operate  on  data  in  such  a way  that 
tlie  outputs  of  the  data  compressor  are  actual  sample  values  of  the  input  signal 
or  actual  values  within  a specified  tolerant  e.  These  techniques  unnploy  algo- 
rithms using  siinjilo  averaging  technique:.,  ['alynomiU'  pi  udi  ct  oi  s , etc.  A rather 
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tpmpleti'  listing  of  these  techniques  is  given  in  the  Intoriin  recliiiieiil  Hepoxt 
for  Contract  F33615-73-C- 1233,  June,  1974.  Tltese  schemes  rely  on  conventional 
s.ampling  and  the  ase  of  a predetermined  compression  algorithm  and  generally 
require  that  synchronisation  information  or  "sample  tagging"  be  inserted  before 
transmission,  thus  reducing  the  overall  efficiency  of  the  data  compression 
system.  Systems  relying  on  these  techniques  generally  require  a large  buffer 
storage  and  due  to  the  rather  minimal  reduction  ratios  obtained  (2  to  4 in 
most  cases)  do  nut  seem  to  be  contenders  for  applications  in  the  KPV. 
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3.2.2  Orn-dimensional  TrmsfonTiotions 

The  techniques  of  unitary  (orthogonal)  trtins formations  have  been  developed 
primarily  from  the  point  of  view  of  redundancy  reduction  [12].  The  objectives  of 
sudi  a technique  are  to  map  the  original  image  into  another  domain  such  that  the 
redundant  Information  is  readily  evident  and  is  arranged  in  order  of  decreasing 
information  content. 

A one-dimensloi.al  unitary  transformation  can  be  presented  by  the  block  diagram 
In  Pig.  3,2.4, 


Pig.  3.2,4.  Schematic  Diagram  of  (ine-dimenslonal  Transformation. 

The  coding  sy.stem  sliown  in  I'ig.  3.2.4  will  be  unalyr.cd  using  iiuitrix  methods. 

T 

The  N image  sample  values  cun  be  roprescnte.l  by  n colunm  vector  v » u^^] 

in  vector  space  ,S  consisting  of  column  vectors  of  dimension  N.  A linear  orthogonal 

T 

operation  L on  S wliich  transforms  u into  an  Nxl  column  vector  v > [v^v^  ...  v^^] 
in  S can  be  represented  by  the  matrix  multiplication: 

v " Tu  (3,2.1) 

whei’e  the  NxN  matrix  T Is  the  matrix  representation  of  the  llneur  operation  L. 

- 1 T 

Pur  orthogonal  transformation,  T is  on  orthogonal  matrix,  l.e.  T ■ T (for 
convenience,  T Is  assumed  to  be  real)  .md  the  uiuinenis  ol  the  vronslurm  vector  v 
give  the  value'  of  transform  coeffiiieiUs.  Tbf  Inverse  operutlop  to  retrieve  u 
is  accomplished  by  the  inverse  trans tornuition 

t'v  13.2..’) 


U “ 


T 

\ihRre  T is  the  transpose  mutrfx  of  T 

The  best  Inverslble  transformation  fur  random  data,  linear  or  oth.-rwlse,  for 
efficient  roding  would  be  one  which  results  In  independent  coefficients.  Since 
the  problem  of  determining  such  a transformation  tomalns  unsolved  In  general  the 
closest  we  can  get  with  linear  transformations  is  one  which  pr^'diices  uncorralated 
coefficients,  which  in  the  cue  of  gaussian  signals,  produces  independent  sanplos, 
It  hu  been  shown  that  the  transformation  matrix  T which  produces  uncorrelated 
coefficients  Is  usociateu  with  the  autocovurl ones  matrix  of  the  imags  vector: 

Cy  ■ E (uu’’^)  13. 2. J) 

Without  loss  of  generality,  we  usume  that  the  real  random  va:  able  u^  hu  ttro 
mean  and  unity  variance.  Since  .is  u real  symmetric  matrix  It  possesses  a 
complete  orthunomial  net  uf  eigenvectors  corresponding  to  real  eigenvalues.  These 
oigenvrctui's  can  he  chosen  to  be  real.  A mutrix  I whose  rows  me  the  ulgonvector.H 
of  Cy  diagonlios  the  covariance  matrix  Hit  autocovariiince  matrix  of  the 

transform  coefficients  is  given  by 

- ICj'  V oug  (Xj  X,  ...  Xj^] 

where  x^  : . . . ;•  x^  i.r«  eigenvalues  nf  the  matrix  characlert  si  1 c eqimtiuri 

■ X'i  1.3. 2. 4) 

This  trons  format 'on  has  been  known  by  veverm  dl  ffereiil  lumu's  such  its  th'  olgcn- 
\ector  transformation  (271,  the  Hotelling  tnursfoniiut 'on  13),  the  Karhunvn-l.oeve 
t rmis  format  Ion  |7|,  or  haals-rest  rlcted  irons  foimmt  i on  [U'l,  lloncetortb,  it  wll.' 
be  leferriiJ  1.'  ihe  Karhunen- Loeve  t rurisfo rnmt  i on  . 


Other  non-beeie  restricted  linear  transformations  (non-optimum)  other  than 
the  optimum  eisenvector  transformations  have  been  investigated  for  use  in  image 
coding,  Ihosi  include  the  Fourier  transformation  [23-30],  the  Hadomard  trans- 
formations [S3]  (Wel'ih  (sequency -ordering)  Hademerd,  Kronecker  (natural)  lladomurd, 
Pelcy  (dyadic-ordeiing)  Hadomard  [SS] , etc.),  the  Kalah-Hasr  transformation  [3S, 
72],  the  lUscrete  Cosine  transformation  [79,80],  the  Slant  transformation  [75- 
78],  the  niscreto  Linear  Basis  transformation  (88)  etc. 

These  non-optimum  tronefoimatione  produce  only  approximately  uncorrelated 
coeffitiente,  however,  their  computational  difficultlea  ere  greatly  reduced  with 
the  advent  of  fast  transform  algorithms  [94-108],  Furthermore,  these  transfor- 
mations systems  con  be  more  economically  implemented  then  the  theoretically 
optimum  Kurhunen-Loeve  transformations, 

TlteorcUcully , it  has  been  shown  that  for  data  with  autocorrelation  matrix 
having  cl,<  c I ic-t  runslatlonal  symmotry,  tho  uuU'cov'vri  anew  matrix  of  the  transfons 
coufficlents  U dlagonlted  using  Fourier  trons  format  Ion.  Furthermore,  the 
Kalsh-Hadsmerd  transformation  uncorreletes  data  with  dyadic -Markov  covariance 
rntrlx  [40], 

If  the  transformation  is  ciiosen  properly,  the  information  bearing  transform 
coefficient!,  tire  many  oiders  of  biagnltudr  larger  Uwin  those  reflecting  redundancy. 

A cotnson  practice  with  Fturier  vinlysls  is  to  assume  that  the  low- frequencies  are 
important  while  the  high  frequencies  represent  only  noise.  Pic  high  frequencies 
may  tl.on  b«  deleted  in  order  to  compres!,  the  data. 

Pie  process  of  deleting  high-frequency*  terms  may  lie  represented  l»y  a proper 
n,ir  ri  s opn  rut  luti 

‘The  iioie  pv, polar  torn,  "si-  iuency"  has  hccii  ci'ined  by  llarM'th  [1, 4]  as  a generalised 
tri.-queiK)  . 1 uei'  1 4T  I lun-  iiit  ri'd'iii'd  the  terti,  "re,|Ui'nc."  to  iKcoimt  for  the  luud’ei 

ot  re  ro-r  ri  -.s 


M' 


C3.;’.n) 


t) 

V • 


wrture  n i N is  the  number  ot  coefficients  to  lie  retaiiitd. 

2 

The  NxN  tnmcatinji  matrix  is  defined  us 

r i„  0 ■ 

w . . . 

” 0 0 

- • 

where  the  partitioned  matrix  is  the  Identity  matrix  of  order  n. 

Hie  comulirent  matrix  W**  of  W can  also  be  defined  as 

n n 


W 


n 


U,  - W.. 


(3.2. b) 


(3.2.71 


where  and  nre  identity  matrices  ot  ordoii  N and  N-n,  respectively.  Ihe 
series  truncation  process  described  hy  (.3.7.H)  uhore  the  truncatinn  matrix  iu 
defined  in  (.3. .Mi]  is  a non-udaptivo  technique  for  rctalnlntt  those  coefficients 
liuit  on  l!u'  avoi.iyt’  have  the  lui'Kcsi  car'ane'.'  iencru)].  ihls  ) ioccdure  is  some 
tins'!,  refemtl  to  a.s  "tonal  samplini:"  127]  or  "gei/metrlcai  sampling",  (\nothoi 
altnrr.alive  would  be  to  retain  those  coefficients  whose  variances  exceed  a preset 
tliveshold.  This  adaptive  technique  is  sometinies  referred  to  as  "threshold 
samplini;"  |b0|.  Khen  ihteshuld  sampling  is  used  certain  "bookkeeping  information" 
ir.ac  spreif'e:  siiicf  coeCfi  ci  ei.  1 1.  buve  '•  e*  >i  reialnid  id  ilisiirded]  ii.osl  also  he 
coded  for  transmission. 

Tiu  sample  variance.s  of  the  coefficients,  p-resented  m Hg.  .1,2.5  cun  he 
intcqiretod  generalised  power  sped  mi  of  the  cirlgtiuil  data  Note  from  !■ : g . 

3 2,0  that  all  fiie  linear  trap' format  ions  are  approximately  equally  efficient  in 
I'.Kiini;  uu’  lanaiue--  into  low.  i eoji-r  ..A.ei  M v .''lit  . . i i x"  .iiiu  ',2.('  are 


‘the  defiii'tso,  ,1  tiu  triPuatinx  r..itri\  iq,  n 1m',  implieu  ti\;it  thi*  t t'.in-' - 

fonr  t lie  f f 1 • I on  t ' h.id  bei  " .I'l.e'C  ' in  ''I'di  i 'I  diLfi'ing  ,aii.iiici 


(■  I 


Karhunen  Lo2ve 


Transfora  Coaponent 


.'!■  f ; iv.'ii  t\ir  utif  Jiiiii-nsion.tl  uiiitary  tr;u<slunnutiun  with  N - , .li-iuini  iia  first- 

<,  r I-  Markin  liatn,  i.o.,  the  cuvurimce  mutrix  is  a ToepUt:  mairi,':  ot  the  form 


C 

u 


(3.2.8) 


Hieornr  irai  researches  l\ave  sho»«ii  that  when  comp.ared  with  other  linear 
: !■  in-,  fornai  ; jni  in-iu  luiicil  .ihovo  , the  Karlumeii  l.opve  ] 1 ) ti;msfnrmatlon 
aj  i>r.;Ju- I urcorvo  I ated  coefl  icionts  ; 

b)  paoi;'',  till*  ma,\imum  amount  of  cutnulative  variance  into  the  first  n 
coiitt  n'.ATts  (for  any  n) ; 

c1  iiii iij  111  ■o-i  the  ii>ean-.stpa'areil  aiufipUnK  error  due  to  the  truncation 

IM'-  ; . 

I'l' t'e  I ' ' (i  j;  10  iijr,  the  inv.tn-.Miiiare  t riuic.itloii  error  is  ji' V’li  by; 


3.2.3  The  Kt'fgcta  of  Ono-ntiw.nai onai  Tcch.-imms  on  'h>»-DimMi\sional  Data 


Thu  band-limitod  .inalog  signal  Is  sampled  in  both  the  horizontal  and  the 
vertical  directions.  ‘Ilia  input  plctoriitl  data  may  be  represented  by  on  MxN  matrix 
I)  ol'  discrete  Intensity  levels  u(l  ,J) , 1 • 1 ,2  , , , M;  J ■ 1 ,2  . , . N.  In  subsei^uent 
analysis  the  sampling  error  will  be  Ignored. 

Hiooretlcaily  relevant  to  lolev'slon  md  facsimile  transmission,  the  image 
muy  be  assumed  a.s  a two>dim>mslonal  first*order  Markov  procMSs.  Let  u(i,,i)  he  a 
runl,  stationary  random  varioiile  with  zero  mtan,  unity  variance  and  autocorrelation 

R„  (i.j.k.l)  • F.  (u(l,J)u(k,l))  ^ 

where  0 s , o^  S I and  l,k  • 1,  2,  ...  M (3, MU 

J.l  - 1,  2.  ..  . N 

The  Input  data  is  thus  separatoly  correlated  in  uK  directiuns.  'Hie  linpii- 
cation  of  this  basic  assumption  corre  Intinn  .xrp.irnteiu'ss  applied  to  systems 
utilizing  one  dimensional  DPCM  or  laiitary  iriUisfonsotion  technluues  is  considered 
ill  the  following  sections.  Without  loss  of  genorality,  we  assume  that  the  one 
dimensional  DbCM  or  transformation  Is  performed  In  the  horizontal  direction. 

A One-Uimensional  Differential  PCM 

In  a one  dimens Icnul  hl'CK  (or  '.st  order  DPCM}  systom,  the  diifereiice  (enuri 
value  between  an  input  sample  value  and  Its  estimate  is  quantized,  coded  and 
transmitted  to  the  receiver. 

It  ha:  been  shown  that  for  1st  order  Markov  procvi.,  the  best  iuunuI  linear 
estimate  uClij],  In  the  mean- squared  error  sense,  of  the  next  sample  value  uli,i) 
based  un  the  most  recent  »air;ilu  value  available  on  tlie  same  line  uii,j  l)  la: 

'■  { ^ ufi  ,J  1) 

cs 


n (1,0 


(.1  1,0' 


whertt  la  tho  correlation  coefficient  of  horlsontuUy  adjacent  sample  values  as 
defined  In  (3.2. 11) . 

A linear  predictive  encoder  forms  thl.s  estimate  u (1,J)  and  transmitted  the 
difference  or  error 


oO  ,.U  • u(l.j)  ••  (3.2.13) 

1 « 1,  2,  ...  M 

J " 2.  3,  ...  N 

where  «(1.J)  ^ 0,  for  j ■ I 

Tills  process  is  continued  along  the  entire  line  of  the  input  picture  und  U 
vertically  reset  ut  the  beginning  of  the  next  line.  The  two'*dimensioiul  sequence 
of  error  samples  e(i,J)  forms  on  MxN  matrix  B representing  the  error  picture. 

Tlio  two-dimensional  autocorrelation  function  of  the  error  samples  is 


Kg  UiJ.l'il)  ■ • (o(t  J)e(K,l) ) 


(3.2,14) 


It  con  he  shown  that 


\ (i.J.k.n  • (l-kj-l) 


(1-p 


(3,2.15) 


iihere  iS  ^ | Is  the  Kronecier  delta  function. 

It  H prediction  coefficient  A other  than  th*  optimum  (p^)  is  used)  where 
0 i A s 1,  it  can  be  shown  that 


\ (1-1. . 1-1  j 


fll*A‘) 


2,  ..  b 


A (p 


I ..1.1  I 


)]  (3. 2, lb) 


The  horlcontn'  and  the  vertical  corrclati  'n  fuiwtlons  of  the  error  somples  c.in  lie 
olitainyd  separately  by  settlnq  1-K  - 0 and  i-1  ■ 0,  respectively,  llie  horljoiUiil 
ouii'v  I at  1 on  Innctlnn  ol'  tiu'  di  (Torcni'i.  : !ini|il-'  ii.siny  lu'Ui  I he  nptlimiMi  and  the 


bb 


I 1 


non-optimuni  pridiction  coet‘fici«nts  are,  reapertlvsly 

R,  CO.J-l)  ■ (3.2.17) 

and  k (O.J-l)  . (1  ♦ A^)  - A ♦ e (3,2.18) 

We  con  ab’sei'va  that  the  one<dlinen»lonal  l)Rl!M  performed  olong  the  x~Ulreution  forma 
u sequence  of  error  sampleu  whusn  horizontal  conelatlon  is  reduced  or,  In  case  at 
optimum  prediction,  is  zero. 

The  vertical  correlation  functions  are 

(i-k,0)  . (l-o 3 (3.2,19) 

9 X y 

and  R^  (i-k,0)  • ♦ (A-Pj^)^)  (3.2.20) 

Ei(|uatians  (3,2.19)  and  (3.2,20)  indicate  that  the  vertical  correluMon  (unction  of 

1 1 L I 

thu  error  .'tnmples  retains  the  original  functional  form,  ’Htus,  u one* 

diii.ensianul  DPCM  performing  on  one*dlrection  reduces  the  correlation  In  that 
direction  hut  docs  not  affect  the  currolaljon  in  tlie  other  dlroctlun, 

The  above  observation  Is  conformed  with  the  thi*orotical  results  of  optlmum> 
DPCM  techniques  where  a two*dimenslonal  (or  3rd  order)  DPCSI  must  he  used  to  reduce 
the  coirnlrttion  In  buUi  iii  ivcuotis , utsumlnK  » two-dliwnsiunul  Isi  order  Maikov 
p nee  as , 

b One-Utmenslonul  Orthogonal  Transformations 

i'lir  objectives  of  orthogonal  trons toiimit ions  aru  to  represent  the  original 
image  In  rnolhtr  form  t.uch  tint  th.?  redundiuit  infonntiMon  1:,  readily  evident  and 
is  arranged  in  urder  of  decrsaslng  Information  content. 

In  this  suction,  on  nna I •■•u.-.  using  matti\  an|iioa  li  will  he  l•^.’ndorod. 


TJie  input  tmaut'  mutrix  U oC  di  men  .■'Ion  M\N  is  seun  to  lie  comjjused  of  M (IxN) 


row-vectors  Uj  , I ■ I,  ...  M.  TTie  uutocovnri once  matrix  of  is: 


Cy  - E (u^  Uj) 


(3,2.21) 


From  (3,2.21) , w«  have 


la  a 

X X 

a la 


n N-l  „ N-2 
‘’x  ^ • 


which  Iv  a ToifpILtt  matrix  [18]. 


N-J 

*N~2 


(3.2.22) 


lUg.  3.2.7.  Schematic  I'lUBram  of  a Ont-dlmenslon  Orthogonal 
Tiuixformntlon, 


hfterrtng  to  Fig,  3.2.7,  the  llnenr  transformation  of  the  original  Imago  c.nn 
he  ropiesenteU  uy  a matrix  multipl ication : 


V,  1 . '■ 

. lu, 


(3,2.23) 


where  T is  the  matri.x  rupreswntiiUon  ol  no  orthogonal  l roiis furnmt  I »n  whii;h  may  In.' 
real  or  complex,  l.o.,  ■ i’*.  In  the  trainform  domain,  the  transformed  samplo 

vector  v^  h:i:.  autncuvari anco  matrix 

" li  tv^\jl 


0 r 


t:  - 1C  r"' 

v u 


{i,2.J-l) 


(>8 


It  has  l>«t*n  Nhoviii  thct  the  oplin.uni  (KmluinL'h'l.oiM'e)  t rim.^toi-niHUoii  J1  Uifon L zc.s 


rh»  uutocoviii'iniica  muirix  C.^.  n>o  <llaj;onal  elements  of  the  tliuuonal  nuitrlx  nru 
reul  ut gun viil uer  of  the  ioeplitt  matrix  l.c. 


" tJiag  (Aj,  Xj  • • • 


(,V2., 


whtro  X A,  > ...  > X.|, 

t < n 

When  non-hasls-restrlctutl  irons  formations  ore  useil,  suuh  »s  Wulsh-lliuloihoii], 
Wolsh'Miiari  I'nurlor,  Discrete  Cosine,  Slant,  etc.,  the  off-UloKunol  olein«tus  of 
C^,  have  non-zero  values  but  the  correlation  of  adjacent  transformed  coefficients  is 

also  reduced  compared  to  the  original  imngo. 

Hie  vertical  correlation  of  adjacent  hlocks  of  translormed  rouffw Units  cmi 

bn  uhtolnrd  us  follows, 

from  (3.2,2.tJ,  o transform  coefficient  of  transloim  vector  ci,n  be 

nx|ireM I ,'il  |.y 

N 

VI 1 , 1 ) ' ) t(  ,1 , r)  ul  I , n ( ; ' 

1-1 

i.ii're  f(l,Jj  l'<  the  clement  ol  the  1 1 ans  lormiit  om  nnttil.v  I. 

I'Ot  the  coefficient,  the  veilicnl  corre  lat  lot,  is: 


,J  il'.Jl  • li  i \ 1 1 1.1  )vll. , j J I 


or 


i-kl 


H N 


HJI  .J.k.j)  ■ o' 

■ r«l  r'«i 


0 1 ,1  , 1 I ,M  I , r ' 


V.I 

N N ' I r ' I t h 

sbwre  : ,1  ■ M I 1 1' M I I , i"  ; I*  tlie  \:inmU'  ''i  iho  i t i n:,-.  I o n , 

•'  r-lr'-l  •'  ■ 

i;oel  1 1 li'iit  ; It  oiitlmum  I nuis  t n i ni.i  I I on  is  iim'iI,  tlio  i v.im  iin.r  oli-nii  i 

',1th  tho  I ' ''  1' I ,:oTi  v,i  1 no  lit  tl'i  .lull  'in, 1 I . Ml  1 o.iii,,  ! 


From  '3. 2, 1?)  it  cun  be  seun  that  the  tiausl'urm  Loeift  et  enl )wivo  diflur-'iU 


cudus  of  Informutlun  content.  Huwuvur,  thu  currelutluii.s  uf  coufflciuntu  (?f 
the  »iime  order  normiiUsed  to  their  rosprctlve  variunco*  retain  the  fwinctiunul 
form  of  the  vertical  correlation  of  the  original  imnse  in  the  itpulln) 

denrnin.  Thus,  us  in  the  iirsvious  case  uf  onu-dlmensional  Dl'CM,  thr  one-dlmensionnl 
orthogonal  trails fonnation , elthnr  optimum  or  uon^upt liiium,  pon'ormed  on  liortront.il 
blocks  uf  data  decorrsiatos  the  resulting  transform  coefficient  In  that  direction 
but  does  nut  aft'nct  the  vertical  correlation. 

Summarily,  with  the  basic  ass'.imption  of  representing  the  iripot  image  by  a 
separate,  two>dimensiurial  flrsl-'Order  Markov  prooess,  une> diiMrh!' Lonai  techniques 
(bi'CM  or  transfunr.uUon)  can  only  douorrolute  the  mapped  image  in  tlie  direction 
of  operution.  Tlie  redvmdiuicy  Inherent  in  the  other  directum  remains  intact  and 
another  operution  should  be  done  in  thut  dl'-uction,  either  by  bl’ilM  or  orthogonal 
ir'iiit' formation , In  order  that  all  reilinidanry  Is  to  be  efflclci.tl)  ronoved.  A fwo- 
dimeoslonal  operation  ciui  be  obtained  l>y  n rominnulioii  of  'me-dlmon.sl  utuil  lil’l'.*^t  .tnd 
ui.iiary  trims  format  I on.  'this  comlunutlon  re-.iiitf  in 

Hi  Iwo  dimensional  imCM  < r .lul  order  (.Vpoinii  IH’dM; 

U' iwo  di  .I'ein  I uiiu  I unitary  i i .ms  foimat  lon  or  1 lock  quant  1 al  i on  ; 

1.3;  Trim»fons-l)l’CMi 
and  ( 4 ) I'i'i'M-  I I'.eis foni<. 

ilu'  lust  tVfO  tvcbnlques  mentioned  iibovi  ':oi.|1'Imu  the  Hybrid  Coding  neiliods 
which  aio  dU'tlnct  by  their  respective  orOri  of  o|>v  riit  1 ons  . 

Hic  abort  liliiiij.'.  Ion  lO'MlIing  fii't'.  ti.i  l.isir  iis..niii|  t i "ii  >|  biMi'tltmal 
■ t |ii  rat  me-.  . to  In'  in  contra. i i.ilh  u-.iiltn  obtained  liom  diitn  of  mmI 

I'lliJI'est.  L.illh  I do  r i :ig  the  corr"l;lHoil  M the  original  m iige  ol  the  I i'lick  (Hi 
llg.  f)  and  ol  the  I iror  plitun  ol'l.t.n.d  In  ."O  di  nn'o.  nm.il  (ipt.M  hi  the 


?(' 


v«rtLcuJ.  dir«crioii  (in  Fig,  3.2.9]  It  can  soon  thnt  the  vertical  corrslntton 
ot'  the  error  picture  is  signiticnni ly  smaller  tlmn  that  of  the  original  image, 
but  ao  also  is  the  horizontal  correlation.  I'hi.^  deviation  from  the  theoretical 
analysis  witnesses  a questionable  problem  on  the  relative  validity  of  the  basic 
a.'isiunptlon  of  dlrectionally-soparate  correlation.  Thus  in  re.ility  there  exists  a 
certain  degree  of  operational  dependence  contradicting  with  the  directional' 
independence  iitpUcit  in  the  afore-mentioned  theoretical  analysis. 

A DbCM  operation  porfomed  In  one  direction  does  affect  the  correlation  in 
the  remaining  direction.  In  a particular  picture  of  Interest,  the  "Aerial 
photcgrsph",  a DPCM  operation  In  the  horUontal  direction  redaces  the  vertical 
correlation  to  such  an  extrit  that  any  two-dimensional  technique  Introduced 
above  does  not  appear  to  havo  significant  advantages  over  the  one-dimensional 
scheme.  These  results  aic  shown  in  Figs.  3.2.10  and  3.2.U.  The  "Aerial  photo- 
• rnph"  used  in  obtaining  these  results  contained  several  sturagr  tanks  l>'xatt'i 
in  flfll  is. 

A similar  pl\enomenon  also  exists  in  reality  using  one-dimensional  orthogonal 
transformation,  In  the  foregoing  discussions  m relaiKin  with  l>^uatlon 
it  has  been  shown  theoretically  that  a one 'dimensional  transformation  performed 
in  one  direction  does  not  affect  the  curreiation  pattern  in  the  remaining 
dirertlon  Fefenlng  to  rig.  ,3,2.12  wi.lch  presents  the  vertical  onr-rlemei.t 
delay  correlation  of  the  If)  transform  coefficients  resulting  tiom  n one* 
dlmentionsl  Wilah'ltadairurd  t rens  format  ion  In  the  horltoncal  direction  of  the 
pictures  ci’  the  Tank  nn  I the  Trucl  , It  ran  he  s'ser  that  the  correlation  betwevn 
adjir;tnc-»  rai.sforiT)  c’C'f  Ic  ients  v.irles  unpredUlnhi/  ' ith  sequonclns. 

Mg.  . ...I.'  shows  tin  var  nice.,  of  ffie  ti  (nsfort.i  cv  I'f  f ' o I ent  (,  usiii^  » mu*- 
d I'sen.)  f ops  ! Ilndamanl  t rat)s  (OT'r.m  > i on  n''d  lilocl  si  fs  ,f  In  and  1‘ig.  .',.',11 

show  I tl',0  VI'?  Ill")  of  til'  d 1 f to  1 iMui'  'n  I , I ;i.,.  roe  f f I . l « :it ' I't  ttii' 


T.  TT.-'vviir-" 


'iff?’ 


9dme  sequency.  These  are  the  results  obtained  in  making  a one-dimensional  trans- 
form in  the  horizontal  direction  and  taklnj*  the  difference  in  the  vertical 
direction.  These  results  Indicate  that  there  appears  to  be  little  advantage  in 
performing  DPCM  in  the  vertical  direction,  It  should  also  be  noticed  that  the 
variances  of  the  difference  signals  tend  to  level  off  at  a relative  high  level, 
indicating  that  all  coefficients  of  order  higher  than  20  are  of  equal  importance, 
rig.  3. 3. IS  shows  the  variances  of  the  one-dimensional  Hadamard  transform  coeffi- 
cients of  the  difference  picture.  To  obtain  these  results  DPCM  techniques  are 
used  In  the  horizontal  direction  and  transform  techniques  in  the  vertical 
direction  using  the  "Aerial  photograph".  Again  no  significant  Improvement  Is 
saen  in  using  this  two-dimensional  Hybrid  technique  over  the  one-aimenslonal 
»cheine,  It  is  again  apparent  that  coefficients  after  order  15  are  of  equal 
importance.  These  results  tend  to  indicate  that  little  is  gained  from  the  two- 
dimensional  Hybrid  schemes  for  this  type  of  picture, 

Fig,  3,2.16  shows  the  variances  of  the  one-dimensional  Hadamard  transform 
coefficients  of  the  difference  picture.  Note  that  in  this  cate  the  use  of  the 
two-dimensional  Hybrid  scheme  gives  good  results,  The  variances  of  the  higher 
order  coefflolont.s  decrease  continuously,  with  the  higher  order  terms  becoming 
insignificant,  Similar  results  are  shown  in  Fig.  3,2,17  using  the  Transform- 
DPCM  technique,  These  results,  using  the  picture  of  a "Face"  (a  still  picture 
of  a face  of  a woman),  are  in  direct  contrast  with  those  obtained  using  the 
"Aerial  photograph"  and  indicate  that  unless  the  correlation  is  high  in  both 
spatial  directions  little  is  gained  in  using  a two-dimensional  scheme. 

Figs,  3.2,18  and  3.2,19  show  the  percentage  of  energy  contained  in  the 
coefficients  for  the  one-dimensional  Hadamard  transt'orni,ation,  the  difference 
of  transform  coefficients  ,ind  the  transform  of  dlfforence  samples  for  the 
scenes  of  the  "Face"  nnd  the  "Aerl.nl  photogi'uph" , Whan  only  a portion  of  the 


coefficients  are  retained  for  furtlAer  processing,  the  performiince  of  a hybrid 
coding  ."cheme  would  give  better  results  for  the  scene  of  the  "Face"  than  for  the 
"Aerial  photograph"  as  far  as  truncation  errors  are  concerned. 
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FRACTIOM  or 
COEFFICIENTS 


Fig.  3.2. 


19.  Energy  of  Transform  Coefficients  (aerial  photograph). 
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, 2 . 4 2i'0 " m-HKin.slonal  Irars formation » 

If  Che  original  Image  is  arranged  into  an  NxN  matrix  U with  sample  elements 
iiJ  “ li  •••  N,  a two-dimensional  orthogonal  transformation  T operates 
o:i  U and  produces  n matrix  V uf  transform  coefficients  v(i,j),  i,J  ■»  1,  2,  ...  N 
is  given  by 


V - TUT' 


The  Inverse  operation  on  V to  retrieve  U is  accomplished  by 


U - T*VT 


A generalized  two* dimensional  transformation  and  Us  Inverse  may  be  defined 


V - Tjiny  (3.2.30) 

nnd  U - tJvt^  (3.2.31) 

ivhcra  I'l  and  are  orthogonal  matrices  and,  in  general,  »<  T^.  Equations 
(3,2.30)  iind  (3.2.31)  will  he  identic.sl  to  (3.2,28)  and  (3.2.29).  respectively, 
when  • T^. 

The  ^onora.tiiod  two -dimciul onul  tronsfommtion  defined  by  (3.. ’.30)  may  be 
considered  a.s  an  extension  of  ono-dimenslonal  scheme  by  svparating  the  former  into 
two  Independent  procedures  as  follows: 

(P  A one-dimensional  transfomtatlon  opurntos  on  tho  columns  of  U to 

produce  .in  Internipdiate  matrix  V,  l.o,  V ■ TjU  (3.2.32) 

I.2J  i!\t’  .:outficiont  malri.x  V is  obtained  by  u second  oni'-diinensional  trans- 
formation I,  opi’rutlng  on  V,  l.o.  V ■ (3.2.33) 


,r  mii.n 


Cluurl/,  both  thf  otie-Ulmen<tlonai  cronsformatlon  (3.2.2)  mul  the  two-dimenb Lonal 
transformation  (3,2.30)  result  in  a set  of  coefficients  onch  of  which  is  a linear 
combination  of  the  data  sample  values. 


The  characteristics  of  one-dimensional  transformations  discussed  in  preceding 
sections  con  be  similarly  applied  to  the  two-dimensional  case,  from  (3.2.32).  a 
column  c^,,j  of  the  Intevnedlate  matrix  V is  expressed  by: 


(3.2.34) 


where  c^j  is  the  j column  of  the  image  matrl.x  U. 

ilse  input  sample  u(l,J)  is  modelled  as  a real  rondom  variable  of  a two- 
dimensional  Markov  process  whose  correlation  function  is  defined  in  (3,2,35).  i.e. 


E (u(i.J)u(k.Dl 


p U-M  p IMI 

y 


(3,2.35) 


The  column  covananco  matrix  C of  any  dato  column  c , j • 1 , 2 . , . , N is 

yu  ' uj  ’ 


ubculned  from  (3.2.35)  to  he 


I;  ic  ,c  /) 
u)  uj 


1 . N-1 

I Oy  •••  % 

' 'N-2 

cl  p 
J f 

• N-1  ; 

Py  ...  1 


(3.2.30) 


l.'ro:'  rt'.ullx  of  the  I'rccodiin)  soctlon,  if  the  row*  of  the  t ram  format i on 

mjtri,x  I'j  arc  eigenvei-tors  a.ssoclated  with  eigenvalues  k » 1,  2,  ...  N of  the 

column  covariance  matrl.x  C then  the  elements  of  column  vector  c are  uncorre- 

yu  v'j 

l.itJd.  'Hie  Karhuiien- l.oeve  transfomuiMon  operating  on  all  columns  of  U 
produces  an  intermediate  matrix  V which  Is  composed  of  imcorrcliitcd  columns,  i.e. 
tlu;  coiaiTunco  n.atri.x  of  each  column  c^,,j  is  diagonal; 


\v,' 

' J ' ■ 


(3, 2., 37} 


87 


with  ^ " *•  2.  ...  N. 

From  results  of  the  theoretical  analysis  of  ono-dimens' onal  transformations, 
It  can  be  seen  that  the  row  correlation  of  the  transform  values  of  V Is  affected 
by  the  decorrelation  process  using  one-dimensional  aigunvector  transformation  . 
The  row -correlation  of  element  v'(i,J)  of  row  can  be  written  us 


E (v'(i.J)v'(l.k)}  - 


The  row  covariance  matrix  of  r , , is 

v'  1 


<^xV,  " ^’•vM  ^•i^  “ Vi 


(3,2.2)  a row  of  the  transform  matrix  V is  e.tpressed  by 


fvi  - S.i 


« T r 


Then  if  the  rows  of  are  eigenvectors  associated  with  eigenvalues  i k ■ 

1,  2,  ...  if  of  the  row  covariance  matrix  C , the  elements  of  the  row  vector  r , 

jtv'^  vi 

are  uncorrelotod.  Tlie  row  covariance  matrix  of  row  r^^  Is: 


^xv^  " \i  ^^xl  \2  •••  ^xU^ 

1 • 1.  2,  ...  N. 

To  conclude,  the  two-dimen.slonul  transformation  in  (.3,2.30)  with  Individual 
Kurhunen-Loove  trans formations  T^  and  Tj  prooerly  chosen,  produces  u trunsfom 
r.oefficlont  matr' x whose  elements  ,ire  uncorrelntcd  in  all  diiectiuiis.  Tlie 
variances  of  transform  coefficients  are  different  in  magnltudn.  lluis  the  infor- 
mation contents  of  each  cuef ficlcrt  is  different, 


In  such  a case,  the  variunco  of  a transform  coefficient  v(i,J)  is  given  by 

Ci.J]  “ E (v^i.j))  . Xyj  (3.2,421 

The  transform  matrices  and  Tj  are  associated  witn  the  vertical  correlation 
coefficic'.t  p and  the  horizontal  corrolutlon  coefficient  p , respectively.  In 

7 ^ 

general  Oy,  hence  ft  Tj. 

The  non  basls*restrlcted  transformations,  as  their  names  implies,  are  indepen* 
dent  of  the  statistical  chartxteristics  of  the  image. 

Therefore,  two-dimeu.'-ional  orthogonal  transformations  and  their  inverses 
using  Discrete  Fourier,  Hadamard,  Haar  matrices,  etc.  are  defined  using  (3.2.28) 
and  (3.2.29)  respectively. 

Retaining  the  n coefficients  with  the  largest  variances  by  a series  trans- 
action process  can  be  viewed  as  a "zonal  filtering"  or  "masking"  in  the  transform 
domain  12V], 

Similar  to  the  one-dimensional  case,  the  mean-square-approximatlon  error  due 
to  the  truncation  process  in  reconstructing  the  original  Image  by  on  inverse  trans- 
fnrmatior  is  given  by  the  variances  of  the  retained  coefficients,  i.e. 

eJ  - 1 - 4 2 Ci.J)  (3. 2. 43. a) 

i,.i  '' 

IVhen  Kavhunen-Loeve  transformation  is  used,  o*  (i,j)  is  given  by  (3.2.4?), 

And  the  total  system  mean-square  coding  error  including  the  quantization  error 
encountered  in  (luantizing  the  retained  coefficients  for  transmission  is  similarly 
obtained  as : 

- 1-4  ^ 4,  (l,j)  * 4 ^ (3.2.43,b) 

N t.J  i,.i  ^ 

assuming  a noiseless  troJismlss Ion  channel. 
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3 . 3 Hybrid  Cndini;  Technlquea 

One  of  the  most  Important  objoctives  of  an  efficient  coding  system  is  to 
produce  uncorrelated  sample  values  even  if  tlie/  are  not  necessarily  independent. 

For  images  whose  picture-elements  (pels)  are  correlated  in  all  directions, 
one-dimersional  techniques  are  not  sufficient  in  removing  all  reduridancy  which 
is  inherently  embodied  In  the  image. 

At  present  we  are  concerned  with  the  techniques  of  DPCM  and  orthogonal 
transformations,  A two* dimensional  scheme  can  be  introduced  by  any  possible 
combination  of  nne-dimensional  DPCM  and  one-dimensional  transformations! 

(1)  DPCM-DPCM, 

(2)  Tran.Hform-Transfonn, 

(3)  Trtnsform-DPCM, 
and  (4)  DPCM-Transform. 

Tne  first  two  combinations  are  identically  equivalent  to  tho  third-order  (3- 
pcint)  DPCM  and  the  two-dimensional  transformation,  respectively.  TTie  last  two 
combinations  constitute  the  Hybrid  CoJirg  Technique  which  is  the  subject  of  this 
section. 

3 . 3A  Transform-DPCM  Coding  System 

As  implied  by  its  name,  the  Trans  form- DPCM  techiilque  results  in  a coding 
system  In  which  the  transform  coefficients  produced  by  a one-dlmnnsional  ortho- 
gonal transformation  in  the  hori,5ontal  (vertical  direction)  are  subjected  to  a 
predictive  quantizing  system  operating  along  the  vertical  (horizontal)  direction. 

Without  loss  of  generality,  wo  assume  that  b one-dimensional  transformation 
of  individual  rows  of  the  image  matrix,  l.e.,  in  the  horizontal  direction,  produces 
a trajisform  coefficient  i„atii,x  whose  individual  columns  are  subjected  to  DPCM 
coding.  The  hlock  diagram  of  the  propcsed  l.'brid  sysiviii  Js  shown  in  Fig.  .3.3.1. 
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Fit-  3.3.1.  Transfor«-DPCM  Hybrid  Codiof  Syste* 


The  first  stop  in  impiomenting  a Transform-DPCM  system  is  tn  divide  the  MxM 
image  matrix  into  a set  of  nonoverlapping  rows  of  N pels  where  N ■ 2^  is  on 
integer  multiple  of  M,  as  illustrated  in  Fig,  3.3.2, 

The  image  Is  thus  a collection  of  L,  L ■ , vectors  of  dimension  N.  For 

simplicity  we  will  consider  only  the  first  vertical  subset  of  M vectors  and  let 
Uj,,  u^  denote  the  collection  of  M data  row  v»ctors>  i,e.  , u^  ■ [u(i,l) 

u(i,2)...  u(i,N)] 


N 


1 " 

1 

ixxx^xj  bx...iLj 

XXX.. ,X  1 

1 XXX ...  X 

• 

• 

• 

XXX. . .xj 

XXX.  . .X 





Pig,  3,3,2,  The  Partitioning  of  MxM  Image  Into  IxN  Subimages. 

Each  data  vector  u^,  i > 1,  2,  . , M is  projected  into  oi;  N-dimenslonal  coef> 
ficient  vector  ■ [v(i,lj  v(i,2)..,  V(i,N)]  using  a one-dimensional  orthogonal 
transfonnation  represented  by  a NxM  matrix  T whose  rows  form  a complete  ortho- 
normal  set  of  basis  vectors  Tj,  T^,  ...  The  i coofflcient  ;ow  is  given  by 

V,J  . Tu/  (3.3..) 

where  the  i,j‘  element  is: 

Vll.J)  - Tj  uj  ; 1 - •••  M (3.3.2) 

J - 1.2,  ...  N 

Since  the  dnta  vectors  Uj^  are  vertically  ;«l|acont  It;  the  spatial  domain,  their 
corresponding  transform  coefficloiu  vectors  Vj^  will  also  be  vertically  correlated. 
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The  column  correlation  of  the  J " tranaform  coefflclont  v(l,j)  is  given  by 

E (vd.J)  v(k,j)}  - ojj  (3.3.3) 

y f h 

whore  is  variance  of  the  j transform  coefficient.  In  the  particular  case 
of  Kavhunsn-Loeve  transformation,  •Ji  ■ the  eigervaluM  of  the  Toeplitz 
covariance  matrix 


1 o „ N-1 

, ' Px  ‘ • "x 

•^x  • • • 1 


(3.3.4) 


Equation  (3.3.3)  indicates  that  the  correlation  functions  of  transform  coefficients 
normalized  to  their  corresponding  variances  in  various  columns  of  the  truisformod 
array  are  identical  to  the  correlation  of  Image  samples  in  the  vertical  direction. 
This  functional  relationship  is  Invariant  to  the  different  types  of  tra.cs formation 
employed  • basls>restrlcted  or  non  basis-restrictod. 

A number  of  different  DPOt  coders  are  subsequently  used  to  encode  the 
individual  columns  of  the  retained  transform  roefficlents . Note  that  in  oil  the 
Di’CM  orders  the  same  feedback  coefficient  is  employed  resulting  from  the  identical 
normalized  correlation  of  coefficients  ot  all  sequencies. 

Studios  of  linear  prediction  theory  have  shown  that  for  first-ordwr  Markov 
process,  the  optimum  linear  estimate,  in  the  least  moan*square  prediction  error 
sense,  of  a transform  coefficient  v(l,j)  can  be  obtained  from  the  previous  coef^ 
flclent  in  the  transform  column,  l.o. 


v(l.J)  ■ v(l-l.j) 


1 2,5,  .,  . N 


(3.3.S) 


In  the  follo' iiig  discussion,  w«  will  analyse  the  pprtormunua  of  tin;  Transfonn- 
DPl:M  Hybrid  coding  system  using  a prediction  coofflr''’nt  which  crui  cither  be 
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optinuin  or  non-optimum.  To  pxtund  our  goneralizatlon  further,  we  will  assume  that 


It  Is  possible  to  use  different  prediction  coefficients  Aj,  ...  A^  for  different 
DPCM  coders,  l.e. 

vCl.j)  ■ Aj  v(l-l,3)  . (:i.3.6) 

The  coefficient  difference  or  error 


d(i.j)  - v(i,j)  - Aj  vCi-l.J)  C3.3.7) 

is  quantized  and  coded  for  transmission. 

At  the  recelvvU'  end,  the  channel-corrupted  somple  value  e^(l,j)  is  added  to 
the  predicted  sample  v^(i,J)  to  reconstruct  the  coefficient  v^(i,j)  which  is  a 
corrupted  version  of  trensfonn  coefficient  v(i,J),  1 e. 


J)  * Aj  v^(i-l,3) 


(3.3.8) 


Finally,  an  Inverse  transformation  operating  on  oauh  row  of  v^(i.J)  reconstructs 
the  image. 

The  output  sample  vector  u^^^  ■ (uo(l,J)  u^(l,Z)...  u^(i,N)]  reiultlng  from 
the  hybrid  codlny,  of  Input  imege  vector  within  some  degree  of  error.  For 
mathematical  tractability , the  objective  performance  of  the  proposed  coding  system 
are  measured  by  the  total  mean-square  coding  error 


1 


N 


‘TD 


(3,3.9) 


'fho  total  system  mron-square-error  defined  In  (.3.3,9)  will  be  evaluated  In  the 
following  analysis,  For  clarity,  the  j'’*'  Ol’CM  coder  is  shown  hero  for  further 
reference  (Hg.  3,3,3) 


Rtftrring  to  Pig.  3.3.3,  th«  prodlctod  coofficiont  v(i,J)  tho  trinimittor  con  bo 
oxprtiitd  by 


V (i.J)  - Aj  C*(1-IJ)  ♦ V (3.3.10) 

Till  iiquinei  of  pridiotid  tranifonn  coifficlinti  con  bi  Jirivid  from  (3.3,10)  ai 


V (i-l.J) 

- (i(i‘2,J)  ♦ V (1.2, J)J 

V (i-k,J) 

■ Aj  (#(i.k.l,J)  + V (i-k-l,J)] 

(3,3  11) 

or; 

V (l.j)  - 

t a/  e(l-k,J) 

k-1  ^ 

(3.3.12) 

At  tho  recilvir,  thi  pridlctid  coifficiint  v^Ci.J)  con  bo  liMUjrly  oxproiiod  by 
coniidirltig 


Vj,  (l.J)  - Aj  v^d-l.j)  (1.3.13) 

Slnco  V|j(l-1,))  - fjj(l-'.J)  * (3.3.13)  can  bo  rowritton  as 

Vg  (l.j)  - Aj  [ipCl-l.J)  ♦ Vg  (i-l.J)  (3.3.14) 

Tr.j  ssqucnco  of  prodictod  cooPi'Ulont  rocotiitructid  ut  the  vecoiver  Is  derived  from 
(3.  3, 14) : 
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(3.3.14) 


Vq  (i-l.J)  ■ [o^(i-2J3  ♦ ;pfi-2.j)l 

Vq  (i-k.j)  - Aj  [«^(l-k-l.j)  ^ v^d-k-l,))] 

Hence,  con  be  appro^dmated  as 

W k 

V.  Ci,j)  • n A/^e^a-k.j)  (3.3.15) 

® k-1  J ® 

Protn  (3.3.12)  and  (3.3.15)  the  ttansform  coefflclant  v(lj)  and  its  corrupted 
version  v^(i,j)  are  obtained  referritg  to  Pig.  3.3.3. 

^ k 

v(l.j)  - £ a/  e(i-k,j)  . q(i,j)  (3.3.16) 

k»0  ^ 

” k 

*nd  V (ij)  .•  r.  A,**  oJi-k.))  (3.3.17) 

“ k-0  J ® 

whe;'v  q(l,j)  « o(i,j)-d(i,J)  is  the  quantising  noise  associated  with  transform 
difference  d(i,,1). 

rhe  reconstructed  image  sample  u^(i,j)  is  obtained  l>/  the  inverse  orthogonal 

It  re« 

transformation  T , where  T'*  ■ [iKiJ)]  * of  the  noise-affected  coefficients 
Vg(i,l)»  v^(i,2),  ...  Vy(i,n)  and  can  be  expressed  as! 

ii 

%(ij)  - I ♦(r.J)  v„(i,r)  (3.3.18) 

° r-1  ° 

Similarly,  the  image  sample  u(i J)  con  be  considered  as  resulting  from  the 
inverse  tronsformot'.on  T"^  of  coefficients  v(i,l),  v(i,2),  ,,,  v(i,N),  i.e. 

N 

u(i.3)  ■ £ Kr,))  v(l,r)  (3. 3, in) 

r-l 

The  reconstruction  srroi  r(lj)  ■ u (l,J)-u  (IJ)  if  calculated  using  (3.3,16), 

c 

(3,3,17),  (3.3.18)  and  (3.3.19)  to  yield 
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— iiiiia 


K als.  ji.iuuaau.w.  L'c.a .. 


N n 

tCiij)  - I Hr,i)  vfi.r)  - I 

r«n+l  T«1 


n M ^ 

S £ A%(r,J)  c(i-k.j) 

r«l  k"0 


C3.3.20) 


\vh«r«  c(i  J)  ' V^C. it  th«  channtl  arror  ratulting  from  tranimittlng 

2 

Cata  over  a noloy  channel.  The  total  system  mean*tquared  error  defined 

In  (3.3.9)  it  rewritten  as; 


2 1 M N 2 

•n  ■ ro  J.i 


(3.3.21) 


Totty  and  Clark  [138]  have  shown  that  if  the  quantitation  proceti  it  done  in 
tn  optimum  mariner,  the  channel  error  and  the  quantization  error  are  independent. 

It  has  alto  been  shown  that  whon  the  quantization  is  done  finely,  we  can  aitumn 
the  quantizntioti  noiae  and  the  quantized  temple  independent.  Puithermore,  tince 
dflij)  « v(i,j)«Aj  v(i-l,J)  is  a finite  linear  combination  of  transfonn  coeffi- 
cients the  assumption  of  uncorrelat.edness  between  the  transform  coefficient  and 

the  quentizatior.  noise  follows,  keat.icting  ouruelves  to  the  above  approximation, 

2 

the  total  system  coding  error  in  (3.3.21)  can  be  formulated  as; 

•j  1 ^ 2 1 2 

■"  ■ “'j  * " s.i 


, M n M 2],  2 

r E Af  E {C^i-k,j)) 


^ i'.l  ;.l  5.0 


(3.3.22) 


2 th  2 

where  is  the  vari'i.'ce  of  ths  j transform  coefficione  and  the  variance  of 

quantization  noise  In  the  DhCM  systems.  Recalling  that  the  hovi:ontal 

covariance  matrix  of  transform  coefficient  Is  the  orthogonal  transfoimatlon  of 

T 

the  horizontal  covariance  matrix  of  the  original  image  i.e.  and 

that  orthogonal  transformation  preserves  the  Irani-  of  tlia  transformed  matrix,  i.e. 


- J ■' 3.L\-i  tla  v.  r.| 


Trace  ■ Trace 

N 2 

£ oj,  . N 

J-1 


(.3.3.23) 


The  above  relationihlp  can  be  applied  to  (3,3,22)  and  the  total  eystotn  mean* 
equarc  error  can  than  be  expreised  in  xelatlon  with  the  n retained  tranafom 
coefficients, 


2 1^2  1 2 
‘TD  ■ * ITj./qi 

1 M n M 2|<  2 

♦ £ £ £ Af  E {c*(i.kj)) 

1-1  J«1  k«0  J 


(3.3,24) 


F 


I 


i 

f 

r 

V 

\ 


It. 

{ 

f. 


. 


lUO 
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3.3  B Tht  DPCM‘Tr»»sform  Syaiem 

To  compltt*  th«  lilt  of  all  possibU  comblnatloni  of  ont-dimaniiional  tcch* 
niquts  ompbaaiilng  on  cht  dtcorrolating  of  multldimaniilontlly-corroUted  data,  wa 
propoaa  th«  DPCM-Tranifom  hybrid  coding  ayatam  aa  illuatratad  in  Fig.  3,3.4, 

Ai  tha  dasignaiion  lnq)liai.  tha  DFCN>Tranafomi  aystam  ymploys  at  tha  trr'j. 
mlttar  and  the  racaivar,  ona>dimenaional  orthogonal  tranaformation  of  tha 
diffarancaa  or  arrora  batwaan  tha  image  aanpla  valuaa  and  their  correapondlng 
aatimatea.  Tha  tranifomad  diffarancaa  arc  than  quantiiad  and  codad  for  trann- 
miaaion.  A ravaraa  procaaa  at  tha  racalvar  and  raconatructa  tha  image  namplaa 
within  an  acceptable  limit  of  degradation.  A aimplifiad  block  diagram  of  tha  OPCM* 
Tranaform  coding  ayatam  ia  ihown  in  rig.  3.3.5. 


Fig,  3.3.5.  .StnmllficJ  .'^lock  Diagram  of  the  urCM-Trana form 
Coding  .s,’itan'. 


The  DPCM’iranaform  ayatam  ia  baalcaily  a modified  one>dlmenalunal  DPCM  coder  in 
which  onj'dimanaional  orthoyonkl  trinaformatlon  prnceasaa  are  incorporated  to 
further  exploit  the  dlrectlonjl  correlation  ui  input  image  which  cannot  nc 
completely  removed  by  the  one-dimenalonal  PPCM  process  alcie. 

In  the  following  di.scusilon,  the  *.y!item  nperaticn  iu  '•■rlefly  out  in.;.. 
fisiiUmlng  vhnt , without  loss  uf  ,;onerallty,  the  lU’CM  process  operates  on  columns 
of  IniugH  matrix  (l.e,  in  the  vcrticnl  directlonj  .ind  tho  orlhojjonul  t runs fonuit ion 
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on  rows  of  the  resulting  DPCNUdlt'ferenco  samples.  Keferring  to  Fig.  3.3.4  on  N- 
dii'ensioned  image  row  vector  [u(l,l).  .u(i,N)]  Is  subtracted  from  its  estimate 
given  by  ■ [u(i,l} ...u(i,N)]  using  N Identical  systems  of  delays,  attenuators 
and  comparators.  The  resulting  image  difference  row  vector  d^  ■ [d(i ,1} , , , dCi  |N) ] 
is  subjected  to  n one-dimensio'al  orthogonal  transformation  process  to  produce  a 
transform  coefficient  row  * (v(i  il) . . .v(i,N)]  whose  elements  of  less  significant 
Information-content  are  discarded  and  those  retained  are  quantised  end  coded  for 
transmission.  These  coded  coefficients  which  will  be  subsequently  transmitted  are 
also  fed  back  through  on  inverse  transformation  process  to  produce  on  approximated 
version  of  the  image  vector  whose  delayed  valuas  are  attenuated  to  furnish  the 
estimate  row  vector  in  the  next  UP  CM -ope  rat- ion.  Tha  process  is  continued  in 
tills  fashion  along  the  vertical  direction  for  all  rows  of  the  inage  sample  matrix, 

In  addition  to  the  truncation  sr.-or  oi\d  the  quantization  error  encountered  ut  the 
trinsmlttei',  the  coded  transform  coeffUiants  which  are  tronsmi tted  to  the  receiver, 
in  general,  would  be  contrm.lnatsd  by  noise  in  the  tronsmi'ision  channel  and  their 
nois,'  vevKlons  are  inversely  transformed  to  reproduce  an  approximated  difference 
vector  dOj  ■ [d^Ci  ,i;  . . ,d^(i  ,N',  ] , The  output  row  vector  u^^  ■ (u^^Ci  tO  • . -u^Cl  ,N)] 
which  Is  the  reconstructed  version  of  the  image  data  vector  u is  obtained  by 
addiny  Its  estimate,  which  Is  also  affectod  by  noisy  chonnol,  to  tho  difference 
vector  d^.  Referring  to  Fig,  3.3.S,  the  transform  coefficient  of  the  difference 
sample  con  be  expressed  os 

N 

vO,3)  - t ;tj,r)dfi,r)  r3,3.2S.a) 

r«l 


ov  inv’i’vsely, 

N 

d(l.j)  - I vfi'.jjvd.rl  (3.3.2b.b) 

r»l 
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At  the  rocelvoi  the  estlnaca  u(l)J)  cnii  be  expressed  as 


uCi.j)  - A [d'(i-l.j)  - uCi-l.j)] 


(3, 3. 26. a) 


The  sequence  of  estimated  values  are  obtained  from  (3. 5. 26. a),  i.e. 


u(l-l.j)  • A [d'(i.2,J3  ♦ a(1.2,J)j 


uCl'k.j;  • A [d'(i-k-l,jj  + ud-k-lj)] 


(3.3.26.b) 


uCl.j)  - 2 A*^  d'(l-kj) 

k“l 


(3. 3. 27. a) 


At  the  receiver  Che  sequence  of  estimate  values  u^Ci.j)  which  are  the  approximate 
versions  of  u(i,j3  con  be  similarly  written  as: 


ii  (ij)  . Z fi.*'  d ,(l-k,j) 


(3..3,27.b) 


T.^0  approximations  of  the  difference  sample  * d'Cl.J)  and  - ore  ons- 

dlniensional  transform  coefficients  of  the  transmitted  signal  sequence  and  the 


received  signal  sequence,  respectively,  I.e. 


d'(i..n  ■ I Hr,i)  fvd.r)  + q(i,r)] 

v-1 


■ I [v(i.i'3  + q(i,r)  ■>  c(i,r)] 


C3.3,28.a3 


C3.3,28.b3 


Using  (3.3.25.b) 

.N  H n 

d'U.j)  - dCi.j)  - 2 L <tCr,j)iKr,r')dCi.r’)  + 2 g>(r , j )n  (i  ,r1  (3.3,28.c3 

r'«l  iv.n+1  r»l 

n 

and  vl  (.i.j'j  " d'Ci.Jl  + 1 Kr  ,.i ) t (i . r)  C3.3.28.d) 

' r«l 

q(L.j)  and  c(l,J)  being  the  quanMiation  noise  ruid  rh.-  chiuine!  roise  associated  with 
che  transmitted  coefficient. 


.'U.hAliLi  J . \.L-.  ejlil  ■;.««  t.n  . ^ . i 


, 1,.;. . , .1,.: ..i:.'  .\T.  . -.k  Ki-.l..-.. 


,Th«  cofUng  error  between  tlie  input  inmgo  .sample  tuid  its  roconstructod  version 
at  the  output,  namely  c(i,j),  can  be  a-xpressed  in  terms  of  the-  difference  sample 
and  its  approximates  using  (3. 3. 27. a}  and  C3.3.27.b)  us 


e(i.J)  - u(i,J3  - u^a.J) 

k k 

or  c(i,J)  » d(i,j)  ♦ E A*'  d' (i-kj)  - E A d„(i-k,j)  (3.3.29) 

k«l  k»0  ° 

From  (3. 3.28, a),  (3. 3.28. c)  and  (3.3.2S,b)  we  have 

N n " k 

e(i,J)  • 3 Kr,j)v(i,r)  - E ^(r,j)q(i,r)  - E E A%(r,j)cCl-k,j)  (3.3.20) 
r«n->l  r»l  r-lk-0 

And  the  total  system  mean-square  coding  error  is 


tL  • ^ 3 E (e^lj)}  (3.3.31) 

Restricting  rursolves  to  the  approximations  of  uncorrel atadness  discussed  in  the 
preceding  section,  the  system  mean-square  error  can  now  be  readily  obtained  using 
(3.3.30) 

, , M N N N 

^ E S E E J(r,j)^(r' ,J)  E {v(i.r)vCl.r')} 

1«1  J-l  r-n+1  r'-n+l 

, M N n n 

+ ri  E E E E ♦(r.J)d(r' ,j)  E {q(i,r)q(l,r')} 

i-1  j-l  r-1  r'-l 

, M N n n M 

+ E E E E E A^*^  $(r,J).)(r'.J)  E (c(i-k.r)c(i  k,r')}  (3.3,32) 

i-1  j-l  r-1  r'-l  k-0 


For  orthogonal  transforrution , the  basis  vectors  are  orthonormal,  i.e. 

N 

3 <t'lr,j)'('(r' ,j)  - i , (3.3.33) 

j-l 

being  the  Kronecker  dalta  function. 
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Uilna  (3.3.33),  c^.j,  con  be  further  simplificJ  as: 


‘DT 


M N 


M n 


^ E E E (V^l.j))  + ni  E E E (q^i.j)} 

r*  i ^ 1 j . 1 Mn  j 1 


!■!  j“h+l 
M n M 


i-1  J-1 


+ ~ E E E a"  E {u^l-k,J)} 
i'.l  J-1  k-0 


(3.3,34) 


'(Tie  first  tern  In  (3.3.34)  Is  the  error  Incurred  due  to  the  truncating 
operation  In  which  only  n lower>sequency  coefficients  are  retained  for  further 
processing. 

(n  the  analysis  that  follows,  we  attempt  to  derive  an  analytical  expression 
for  the  truncation  error,  designated  by  c^,  in  terms  of  the  image  correlation 
fanctions.  For  convenience,  the  matrix  notation  will  be  used. 

Tlie  difference  sample  vector  con  he  written  as: 


\ ♦ A(d^,^  ■■  d'^_^) 


(3.3.35) 


Since  ■ A(u^_^  + 


'ind 


'^.i-1  " "i-1  - ‘*1-1 


(3.3.36) 


Rewriting  equation  (3.3. 28, c)  in  matrix  form,  we  have 
d'f  - d[  - T'^wjTd]'  » T’^q^'*' 


(3.3.37) 


whero  q^^  is  the  quantization  noise  vector  associated  with  the  truncated  coefficient 
vector  of  v, , elements  of  q^  corresponding  to  the  discarded  coefficients  havinfi 
:c  ro-v.9k'.ea , i.e,  q(l,j)  ■ 0 for  j “ n*],  ...  N.  The  matrix  represents  the 


tr'oncatlon  process  as  defined  in  ■-.ection  .3.2. 
Using  1.0. 3. .37)  in  (3.3.35)  we  have 


(3.3.S8.a) 


di  - - qi.i’’’) 

Since  T*^  ■ t’*'  and  ■ T'^w't. 

'Hie  soquenc4  of  dlffaronce  vectors  can  be  obtained  from  (3.3,38. a]  as 

■ '‘1.2’^'^  (3.3,38.b) 

‘‘i-k  “ “i-k  “ ^'^i-k-1  * ‘ (3.3.38.c) 


or: 


M 

Z 

k-0 


A*'  (u 


i.k  • ‘“i-k-i  ■ ‘ii-k-.f)"'"?)" 


Note  that  T'^W®T  is  an  Idempotent  matrix,  i.e. 


(T“^W®T)'^ 

n 


T'HyjT  , 


k > 0 


(3,3.39) 


(3.3.40) 


In  matrix  form,  the  truncation  error  In  (3.3.34)  con  be  rewritten  as  1 


1 


M N .. 

«,T  E £ [E  (v 

i-1  j-n*l  ^ ^ “ 


where  denotes  the  j 


th 


diagonal  element  of  matrix  F. 


(3.3.41) 


The  accumulative  sum  of  variances  uf  the  discarded  coefficients  which  consti- 


N 


tutos  t)i‘,  irvmcntioii  error  deseribod  by  the  summation  >. 


T 


[E  (v.  V.  }].  1 can  also 

N J»n*l  1 !•  Jj 

be  equivalently  expressed  by  E [W®  E (v  v. ) W®].,  which  ii  the  trace  of  matrix 

J«1  " ^ 

W®  E (v^^v^)  W®  since  the  first  n lower-order  diagonal  elements  of  the  matrix 
W®  E W®  are,  the  rerjult  of  the  truncating  process,  identically  tero. 

Furthermore,  since  orthogonal  transformations  preserve  the  trace  of  the  trans- 
formed m.itrix,  the  truncation  error  can  be  equally  obtnined  by 

M 


1 


i»l  j«l 


(3.3.42) 
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sine*  ond  T'  ■ ■ 

Ltt  Q - B {djd^} 


C3.3.43) 


1 


Substituting  (3.3,39)  Inti  (3.3,43)  w«  have 

^ ^ k +k  I « 1 e 

Q ■ I S a''  (T  *W„T)  B {(u,  .- 

k-0  k'»0  " 

♦ E £ a’^''*'  (T*Hh®T)  t'*'  B (q 

k«0  k’«0  " 


Jk-.l  ‘»i.k'.l>" 


(T‘^W®T) 

(3.3,44) 


Not«  that  ••  rr'’  • ) and  W®  E ‘*i.k'«l^  '**n  * ° raiultlng  from  the 

charactarlitlc  of  quantization  nuiia  vactor  pvavioualy  dafinad,  Tho  lacond 
.ann  in  (3.3.44)  can  be  allninatad. 

Racall  that,  for  raal  stationary  random  variabla  u(i,j)  ganaratad  from  a 
diractionally-saparabJa  first-order  Markov  process 


E {ufl,J)u(l’J'))  - Oy'^"^'' 


(3.3.4S.a) 


as  In  matrix  form 


B (uJu^)  - Dyl^*^''  C 


X'i 


(3,3.45.b) 


where  is  tho  Toaplltz  natrlx  of  row  correlation  coafficiont  i.a. 


XU 


1 5 . . . P 

X ’^X 


N-n 


N-1 


(3.3.4S.C) 


Using  (3.3,4S.b)  we  have; 


E - Au^.^,j)  Cu^.K-  - Au^.j,,.j))  • ''xu 


where  aj^|^,(A,Py)  ■ (I  + A^) 


|k-k'-l  I lk-k'  + l|,  , , , 

- A(Oy ' ' ♦ jy ' ' ) (.1,  3. 46 , al 


i07 


In  tho  particular  caae  when  optimum  prediction  coafficicnt  1.1  used,  l,e,  ^ • 3^, 
the  coefficient  aj^j.,(A,Py)  becomel 

" \k'^'’y'V  ■ *kk' 

Substituting  C3.3,4A,a)  into  (3.3.44)  we  have,  in  the  general  cose: 


(3.3.46.b) 


M M 


q - £ £ , (A,p J ryTC_T’^®T 

k»0  k'«0  ^ n XU  n 


(3.3.47) 


k-0  k'>0 

let  ^ U(liJ)l  ■ be  the  transformed  covariance  matrix.  Tlie  truricaiion 


XU 


error  in  (3.3,42)  con  tha.i  bo  expressed  in  terms  of  image  correlations  p and  p s 

X Y 

M M 


[I  S c*ki,,l'A,p tl  • ff  I (3.3.48) 

Li  .n  T j-1  « 


let  I 


k-0  k'jQ 
H M 


J-1 


fl(A,pJ  BE  E (A.pJ  h' 


k*k' 


k-0  k'-O 


(3.3.49) 


W1\en  optiiri'jm  prediction  is  used,  i.e,  A ■ p^i  (3,3,46,b)  opplies  and  the 


truncation  error  coefficient  B(A,p^)  becomes 
BIP^.PJ  - (1-P,.^)  E p^^'" 

y y > k-0  ^ 

When  M is  sufficiently  large,  8(p^,p^)  approaches  unity. 


Since 


t P, 
k-0 


2k 


for  M •> 


1-p. 


(3, 3, so. a) 


(3.3.50.b) 


iind  the  truncation  error  would  be 


•?opt  ■ 


(3.3.51) 


which  wou.'.d  be  the  error  expcrionced  if  the  image  sample,  Initead  of  the  difference 
sample,  were  to  no  directly  transformed.  In  this  seme,  It  is  compatlblo  and 


lOR 


nu-n«ricaU/  equivalent  to  its  counterpart  In  the  Trans fem-DPCM  systtin  as  expressed 
In  C3.3.19).  Thus  the  coefficient  S(A,p^)  as  defined  In  (3.3.49^  could  be  Inter- 
preted as  a measuremoiit  cf  Inferiority  resulting  from  deviating  from  the  optimum 
condition,  In  th^  least  mean-square  prediction  error  sense. 

The  coefficient  0(A,c^)  can  be  expressed  in  closed  form  in  what  follows, 

Recall  from  C 3. 3, 46. a}  that 


\l,,CA,py)  ■ ^^.CA.Py) 

or  “k.k'tA'PyJ  . 


1M‘-2Ap. 


, k-k' 


(Oy-A)Pyl‘‘"'‘'l*^  . m' 


(3.3.52) 


’ • k+k' 

let  S(A,o^)  • I E a.  . , (A,p (3. 3. S3. a) 

' k«0  k'-O  ' 

then  for  sufficiently  large  .M  0(A.Py)  i S(A,Py)  C3.3.53.h) 


3(A,o„)  con  be  written  as: 


S(A,o„)  ■ E (l*A^-2Ac„)A^'‘  ♦ 2 E 


k«0 


I Cp,-a)p.J''’'‘' 


k»0  k'“k*l  ^ 


(3.3,54) 


for  k-k' 


fur  k|<k' 


Using  (3.3,S0,b)  vid  let  w ■ K'-k,  we  have 


l+A^-2Ao 

S(A.P„)  ■ j— i + 2(p.,-A)  E 


l-A 


k»0  w»l  ^ 


w-1  .2k*w 
P..  A 


(3.3.55) 


We  can  observe  that  in  the  second  term  of  (3.3.55) 


hrnct 


E E 
k-0  w«l 


p 


w^l 

y 


^2k+w 


m 


k-O 


i« 

A aW  W 

A E A 0 

V/-0 
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(,i.3.56) 


S(A,Py)  : S(A,Py) 


1+A^-JAd^  2A(p^,-A) 

J-A‘  Cl-A^)Cl-APy) 


and  whan  A It  clostd  to  th«t  flrtt  term  In  (3.3.Sb)  approachtt  unity  while  the 
second  term  vanishes . 

To  conclude,  the  system  total  mean*square  error  Cp.j,  In  (3,3.34)  can  also  be 

generally  expressed  as 


6(A,pJU-4t  ijj.j)) 
y " Jrl  * 


4 


1 

W 


M n M 

r I £ 

!■!  J-1  k«0 


a2X 


R (c^i-k.J)) 


(3.3,57) 


C Comptrlson  of  the  Trent  form- DPCM  and  the  DPCNUTransferm  Techniques 

For  simplicity,  we  consider  the  optimum  nsse  In  which  the  one>dlniuntlonul 
transformation  process  It  done  using  Karhuntn*Locv'e  transformation  and  the  optimum 
feedback  coefficient  It  used  in  the  DPCM  system.  IVher.  the  transmission  channel 
la  noiseless,  the  total  system  mean-square  errors  for  both  hybrid  coding  systems 
are  given  by 


2 2 , 1 r 

‘TD  - ‘dT  " ^ 


rr  E A . rr  E 0*. 

^ J-1  ^ j-1 


(3,3.58) 


where  a . is  the  elgcnvaluB  of  the  TuoplJir  covariance  rititrix  of  the  original 

* J 

image  In  tho  horizontal  oirectlon,  and  the  variance  of  the  quantisation  noise 
ussuclsted  with  the  transmitted  coefficient  which  is  ths  dlffertnce  of  trans- 
form coefficients  In  tho  Trane form- DPCM  syetem  or  tlie  transformed  of  difference 
of  Input  sample  In  the  DPCM-Trsnsform  system.  It  can  bs  shown  that  the  Input 
sample  to  the  quantiser  which  is  transmitted  to  the  receiver  foi  both  hybrid 
systems  ere  Identical  regardless  of  the  order  in  which  the  DPCM  nnd  the 


no 


tronafonution  ara  dbna.  Thus  tha  arror  ancountsrad  would  ba  ^dantiual,  assuming 
optlnuffl  conditions)  for  both  ayatsms  and  they  could  bt  conaidarad  aquivalaiit  In 
the  maan*aquart  arror  Sanaa. 

1ha  complaxltlas  Involvad  In  Implamantlng  tha  hybrid  syiitems  would  bo  loss 
favorable  for  tha  DPCM«Tranaform  systam  alnua  It  amploys  an  additional  Invarsa 
transfoxw  proeass  in  tha  faodbaek  loop  of  the  transmittar.  Howavari  tha  pradic- 
tion  coafflclanta  A uoad  in  the  DPCM«Transforn  system  ara  identical,  theoretical ly 
or  practically,  since  it  la  tha  correlation  of  the  input  sample  whlli  In  the  other 
system,  thoso  coefficients  are  generally  different  since  in  reality,  correlations 
for  trnnaform  noefflclants  of  dlffarent-soquency  would  not  ba  exactly  alike  due 
to  the  effect  of  tha  preceding  one*dimonslonal  transfomtatiou  process  as  dlscuasad 
in  prevlot'<;  sections.  Let  s(i,j)  be  the  input  sample  to  the  j quantiser  in  both 
systems,  the  optimum  UPCM  process  in  tha  vertical  direction  yields 

"i  * (3.3.58) 

UHsuming  that  the  Karhunen* Loive  (optimum)  trons formation  is  also  employed, 

Srudiai  of  quantization  noise  have  shown  that 

'’i  (3.3.60) 

where  K(Bj)  is  tha  quantization  error  of  a variate  with  a unity  variance  in  a 
quMitlzar  with  2^^  levels. 

hhen  the  quantization  process  Is  finely  dona,  l.e.  > 3,  K(B^  may  be 
closely  approximiiLed  by  [60] 


h(B^)  ■ b o.xp  (-abj) 


where  b ■ 20 
and 


(3.3.61] 


a « 0.5  In  10 
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Th«  bit  Q.Hslgnmenr.  la  obtalnod  by; 

• :r  *r  ‘"'Ji 

with  th*  constraint 
n 

t B,  ■ M.  (3.i.62,b) 

J-1  J ^ 

balng  th«  total  number  of  bits  fsilgnod  to  one  block  of  transmitted  coefficients, 

ThuA,  the  total  system  mean-square  error  of  both  hybrid  coding  syrtemt)  deslg- 
2 

nated  by  t^^hrlU' 

•^Hybrid  • ‘ C-*B^))  (3.3.63) 

The  totol  system  slgnal-to* noise  ratios,  which  is  defined  as  SNtl  ■ 10  iog^Q 
2 

(1/C|.|y^^^^) , in  the  particular  cose  of  noiseless  channel  given  by  (3,3.03)  is 

presented  In  Pig.  3.3,6  for  verlou.n  bit  rates.  Tl\e  graph  was  obtained  using 

0 K 0,9469  and  p « 0,8798  for  various  transfomiatlon  processes  on  blocks  of  site 

X y 

32. 

Pig,  .1,3,7  shows  the  offnct  on  system  ,)nrfomance  using  different  block  sizes. 

It  cw  be  seen  that  the  improvement  is  negligible  using  larger  block  situ  which 
involves  n.oru  eoniyutational  comploxtt) . 
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■ '•  Hybrid  Codina  in  Noisy  G^annwt 

Th«  th«oretlcal  analyslH  of  the  Hybrid  Coding  syitetn  nerformanges  in  prsvlou* 
section*  Indicates  that  the  total  nia(;n*squBre>error  measure  can  be  expressed  as  the 
Hum  of  the  truncation,  tne  quantitation  and  the  channel  errors,  i.o. 

Slybrld  ‘ ^ 

whore 

tt)  The  tnincatlon  error 


2 


(J.4.2) 


is  a function  the  horisontal  correlation  and  the  type  of  transformation  rhosen- 


U)  The  quantitation  error 


.2 


‘n  ■ n 


i 


is  olitnined  in  the  preceding  section  and  can  be  expressed,  in  general,  as 

n 

C*  - .2AjC^)exp(.aB^)oJ^ 


(3,4.1) 


(3,4.4) 


where  in  the  Trims  form- DPOI  svstem,  the  prediction  coefficients  Aj's  are,  in  general, 
different  due  to  the  stacistlcui  differnnee  of  individual  coefficient 


c)  And  the  channel  error 

M n M 


= e -ITT  2 Z S Aj’^E  c‘(i-k.J) 

® ^ 1-1  J»l  k-i  J 


*t  has  been  shown  that 


‘c  • S’ 


(3.4.5) 


(3,4.6) 


1 • A 


( here  V,  Is  tne  Jth  quant  I tor  lovcl . 
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Essman  and  Wlnti  [ISR]  have  shown  that  If  more  than  3 hits  are  assigned  anti  If 


sauh  level  Vj  is  sufficiently  greater  than  the  standard  deviation  of  the  quantizer 
Input  I ) is  independent  of  flj  and  Vj  and  can  be  approximated  by 


21PB 

2 


C3.4. 7) 


2 

where  PE  is  the  probability  of  channel  error  and  o the  variance  of  the  jth 
quantizer  input. 

Thus,  from  (3.4.2),  (3.4.4),  (3.4.61  and  (3.4.7)  the  total  system  mean -squared - 

error  using  transform-DPCM  system  can  be  expressed  as 

n 


• 1 


1 ^ 
"17  ^ 


(l.b(l+Aj-2Ajpy)exp(-»Bj) 

21PB  (l*Aj-2AjPy  )/(l-Aj))o 


2 


v3.4.8) 


Our  optlrals.nlon  scheme  la  to  ralnimito  the  total  system  me.in-squnrod-error  In  (3.4,8) 
with  respect  to  the  employed  predictor  coefficients. 

Tlieso  optimum  prediction  coefficients  are  obtained  by  solving  n Sth-order 
polynomia  t s , 

Ki(J)Aj.PyK,(J)Aj..-2Kj(J)Aj*Py(2Kj(J)-Kj)Aj 

s (Kj  n)'2K2)A^.Py(Kj(J)  + Kj)  « Oj 

for  J‘»l,2,---,n  (3,4.9) 

where  bexp(-aBj) 

Kj  ■ 21Pt/2 


Ihu  opflmiiin  prediction  coefficients  thus  obtained  for  each  Dt’OM  encoder  Is  a 
Ion  of  , the  luimbor  of  bits  .msignod  to  the  t ran:-; formod  dlfferonco. 

3,(1. 1 ‘.tiiiws  the  opiiin.iri  prediction  cueffi c louts  ns  funcllons  of  the  hit 


F 

i 

I 


assignments  for  probabilities  of  channel  errors  of  0.001,  0.005  and  O.Cl. 

To  conclude,  a theoretical  comparison  of  various  two-dimensional  techniques 
described  in  this  chapter  is  shown  in  Fig.  3.S. 


1 


3 


4 


aits/Pel 


Fig. 3. 


. Compiirlson  of  Two-Dimensional  Coding  Schemes, 

iKarhunen  Loeve  a_»0.9469,  o„-0.8798) ,M«16. 
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StMUUriOM  RllbULTS 


•t . 1 Introduction 

In  thiif  chapter  simulation  results  using  aerial  phuragrnphs  of  the  methods, 
e.tcept  DPCM,  described  In  Chapter  III  are  givon.  Section  4.;i  describes  the  picturus 
to  bo  used  In  the  investigations.  Sections  4.1  and  4.4  give  results  using  two* 
di.nensional  transform  techniques  (Hadumard,  Discrete  Cosine  n.nd  Haur)  and  the  Hybrid 
methods  (Transform- DPCM  and  DPCM- Trans  form)  respectively.  In  section  4.S  the  effects 
of  channel  noise  on  the  two-dltnenslor.al  transform  and  the  Hybrid  coding  schemes  are 
Inver,  tigated. 

Processing  of  the  pictures  were  performed  using  the  IPM  3hO-44  Ohio  University 
Connuter. 

One  of  '■he  main  disadvant.iges  of  dlfforontlal  encoding  is  Its  .sensitivity  to 
noise.  Results  of  optlmliln;.!  the  Hybrid  codinj’  scheme  In  the  presence  of  channel 
no'.ae  are  glvsn  in  Section  4.6, 

'■  ■ * Picture  Statistics 

The  pictures  used  in  the  simulations  consisted  of  six  eerial  roooimalssance 
t;7e  photographs  supplied  by  WPAPB.  Each  picture  consists  of  512  picture  elements 
per  line  and  512  lines.  The  intensity  levels  are  represented  by  an  Integer  number 
be‘;ween  0 and  63,  which  is  equivalent  to  six  blt.s,  E.xcapt  for  a limited  niunber  of 
experiments  using  all  six  pictures,  the  majority  of  the  simulations  were  performed 
using  the  scenes  oi  the  Tank  and  the  Truck  shown  in  Figs,  4.2.5  and  4.2.6,  Figs. 
4,2.7-4.2.10  show  original  p^ct^lreb  of  the  remaining  four  pictures. 

Histograms  of  the  gray  levels  of  the  scenes  of  the  Truck  and  the  Tank  are  given 
'.r.  Figs,  4,2,1  and  4.2,2,  respectively.  Figs.  4.2, uiid  4,2.1  show  the  horizontal  and 


Freciuen>;y 


AVB.  • 39.79085 
VAR.  » 402.1 2531 


4.2.S  Original  Picturs  of  Tank 
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vr 


vi'itical  corrolatit'n*  t'oi  th»  sc«n*.i  ot  tha  Truck  anJ  the  Tank  . Tl\*»e  Clguran 
iiiJicate  that  th#  horlionial  cirrulatlon  la  wuch  hlahar  than  the  vertical  correlation. 
Such  '••haructerlatlcs  Mill  b«  uiei'vl  in  dealgnliig  the  Hybrid  coding  ayatemi  deacribad 
In  S?c:lji'  4.4.  The  Important  statiatlcai  charucterlatlci  are  given  'n  Table  4...1, 


P.lc  ('.ore 
a 

Scene 

Aver«q« 

Vnrlenoe 

Vertical 

Oorrelaticn 

i 

Tank 

lo.mai 

320.309a2 

0.95531 

2 

Tniek 

39.7908S 

402.13531 

0.94434 

3 

Treee 

20.22319 

40a.4969 

0.96697 

4 

rieldi 

32.nS9!tS 

304.5477 

0.90949 

S 

R>eda 

30,04926 

353.5544 

0.96470 

6 

Coaat 

. 

13.B6('iT2 

373.5037 

0.9'1476 

Table  4.2.1.  Statistical  Properties  of  the  Pictures. 


Two- IM mens lona^l  Trnn.sfoim  .Simulation  Ranulta  fNolsaleus  Channel  ) 

S'.'VBiuil  two-dimensional  transform  techniques  wito  Invest ls.ued . Simulation 
v.'su;:i  ii^ive  hu'.'M  obtained  t\.v  tne  Had.tm.ml , the  LMscrote  Cosine  and  the  HaHV  trims- 
ni.iTi  .I  ion.  VnliU'.t  4,.^.Iu,  4 , > Ui  and  -l.t.lc  n've  the  vnrlnnres  ot’  the  two-dtmenilon  i1 
ifiin  .r.in.i  coefriclonts  using  the  Discrete  Cosine,  Walsh  Hudainnr.-l  .and  Walsh  Maar  trans- 
t'o’">  r.  ■'lU'Cl  ivcli  for  thf  scoiH'  oi'  the  Iruc'..  Similar  vesiills  iri*  glvvi  In  Table 
■l.T.;',  l.T.dli  iiiul  I , ,T  .'c  for  the  .s  :onu  of  the  Tank.  1T\e  results  given  in  these 
Ml  l'js  cU'.iiiy  liuliciio  the  red  1 rt I'tt.'ii ion  ,.f  thu  information  Irtw’  the  lower  order'!.! 
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a 


22272.73 

&a9.24 

161.36 

95.23 

45.49 

TiT73 

JI.S3 

19.36 

84S.68 

126.06 

54.69 

31.66 

21.07 

15.31 

13,37 

11.16  ! 

344.18 

69.58 

44.29 

26,71 

17.79 

14.41 

12.38 

9.97 

12'. 40 

43.67 

33.49 

22.85 

16.50 

13.31 

11.19 

10.20 

78.80 

32.69 

24.56 

19.07 

13.78 

12.73 

10.95 

10.15 

48.09 

23.12 

18.02 

15.80 

12.95 

10.05 

10.00 

9.28 

34.54 

18.68 

16.14 

13.00 

11.16 

9.85 

9.85 

8.96 

33.85 

15.69 

14.38 

10.99 

10.21 

9.03 

9.14 

8.34 

h 

22272.75 

467.60 

144.31 

152.29 

48.49 

45.59 

38.88 

40.63 

709.97 

101.96 

46.80 

35,29 

20.88 

19.54 

18.50 

14.90 

293.79 

S/.95 

37.34 

23.98 

17.45 

17.23 

15.88 

11.42 

109.61 

42.13 

28. TS 

21.97 

16.20 

15.84 

13.40 

11.15 

78.80 

31.17 

22,. 35 

18.38 

15  78 

14.25 

1.3.15 

10. BS 

75.65 

26.56 

19.96 

17.35 

13,04 

12.44 

11.82 

10.81 

84.93 

22.95 

10,57 

14.51 

11,50 

11.64 

10.86 

9.56 

69.79 

17.88 

IS. 12 

12.12 

10,60 

10.09 

9.90 

8.39 

c 

467.60 

125.62 

170.98 

41.10 

39.69 

52.28 

40,53 

709.97 

101.96 

40.65 

41.44 

19.10 

18.18 

18,09 

18.45 

245.05 

47.89 

29.18 

27.73 

14.69 

14.89 

14.08 

14.57 

248.35 

52.19 

27.84 

29.31 

1.5.25 

15.27 

1 5 , 59 

14.2  1 

92.  ;o 

24.48 

16.96 

17,22 

11.73 

10.90 

10.23 

11.92 

80.07 

24.03 

17,70 

17.17 

11,45 

11,96 

10.94 

11,14 

74.08 

25.05 

17.37 

16.83 

11.99 

12.40 

11.40 

11.81 

62.82 

24,98 

17.44 

17.67 

10.79 

10.71 

11.23 

12.01 

Table  4.3.1a,b  and  c - Variances  of  Two -Dlmens Iona  1 Transform 

Coefficients  CPictiire  "Truck"! 
Blocksize  8 x 8" 

n - Discrete  Cosine 
b - Walsh  lladi'mard 
c - Walsh  Mnar 
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Variances  of  Two-DimonsionBl  Transform 
Coefficients  CPicturc  "Tank") 

BlocksLzc  8x8 

a - Discrete  Cosine 
b - IVnlsh  Hadamtird 
t - Kiil!:h  llaar 


coaft'lctants  which  Is  necessary  for  data  compression. 

Clearly  the  most  Importont  coefficient  is  Cjj  which  ic  the  U-C  level  of  the 
picture.  Because  of  its  importance,  techniques  for  error'Correcting  coding  for  this 
coefficient  will  be  discussed  in  Section  4.6. 

Piss.  4.3.1  and  4.3.2  show  the  cumulative  sun  of  variances  for  each  of  the 
pictures.  In  both  cases  a block  size  of  8 x 8 was  used.  Using  these  results  one 
can  ditermine  amount  of  anargy  lost  in  truncating  the  coefficients, 

Although  it  is  known  that  maan-squared-error  is  not  a satisfactory  nieusiire  of 
the  "goodness"  of  a picture  in  the  subjective  sense,  it  can  be  usod  as  a rough  quanti> 
tatlve  mcB.surs  for  pictures  processed  using  tht  some  techniques.  Its  usefulness  as 
n measure  of  "goodness"  when  comparing  two  different  techniques  of  data  compression 
Is  quBStlonuble.  For  these  cases  one  would  have  to  revert  to  subjective  evaluations. 
Jn  an  effort  to  determ.lne  a useful  quantitative  error  measure  which  agrees  with  sub- 
joctivw  ovuluations,  several  different  error  criteria  which  ore  listed  below  were 
calculated  and  used  in  some  of  the  simulation  results. 

1)  Norm.^Uted  Mean- Squared -Error  (MSB) 

-J  2 ■'*  2 

‘ i-1  ^ ^ i-1  ‘ 


2)  Normal Ized  Mean-Derivative-Squared-Error  (NDSE) 


N 

/ D Cf 
1-1 


1*1 


-f. 
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3J  Normal  i:*d  Mean-Absolute-Error  j 
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16  32  48  64  Cotfflcltnts 


Fig. 4. 3. 2.  Cum'jlative  Sum  of  the  Variances  of  the  Transform 
Cos dents,  Block  Slzo-8x8.  (Tank) 


wh«re> 


• orljilnol  iiiijnal  valua. 

■ approxLmato  signal  valua. 

Tha  raaults  nbtainad  during  tht  Lnvestigatlon't  Indlcntad  thM  perhaps  the  normaUtad- 
maan-derivatlva-aquarad-arror  (SDSB)  would  ba  mora  corralatad  with  luhjactiva  avaiua* 
tions  rathar  than  tha  MSB  ciitarion.  Tha  pramiaa  behind  th^s  hypotheaii  is  that  the 
cvarall  MSG  nuasurw  doss  not  indioata  local  distortions  in  regions  whore  sharp  contours 
oi'.iat;  howavar,  tha  NOSE  would  tand  to  amphasita  distortions  in  regions  containing 
slurp  contours  and  high  rasolution, 

Tha  results  using  twa<dlmanslonal  Hadanard.  Haar  and  Discrete  Cosina  Transform 
for  bit  riitas  of  0.2S,  O.S,  1,0  and  l.S  blti/pal  ara  givan  In  Tabla  4,3,3H,b,c  for 
both  the  'jcana  of  the  Truck  and  the  Tank.  These  results  Indicate  that  the  Dlscrote 
Cosine  Tronsform  performs  superior  to  oithar  tha  Huar  or  the  HnJajTuird,  Using  MSB 
criterion  one  may  order  the  transfonns  In  tha  following  order  with  respect  to  per* 
forma  IK  e ; 

(U  Discrete  Cosine 
(21  Hadomard 
(3)  Mtar, 

tha  lladai  ard  and  llaur  being  essentially  equal  in  performance. 

Results  ware  obtained  using  several  different  bit  assignments.  Initially  the 
bit  asslgr.ncnt  procedure  describeo  by  Wlnti  ond  Kiirteiibach  ISl  ) wse  used  to  assign 
bits.  The  algorithm  specified  by  tha  authors  Is  basaJ  on  thi-  log  'f  the  variance 
of  t:ie  coefficients  and  Is  shown  to  be  ne.ir  .ipilmon.  In  thlr.  procoJurc  a total 
niinbcr  of  h ts  Is  assumed  such  th.it 

n 

M,  • : B.  (4,j.n 

J . 1 •' 


13b 


Average  Bit/Picture  Eleaent 
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RLScrete  Cosine  i I 0.085479  | 0.063816  1 0-057035 


T^le  4.3.3c  Jfcan-Absolutc-Error  (MAE)  Using 


wbort  l«  tht  bita  aislitnvd  to  coeft'lclopr  r.j . llilng  tagranga  muUipUtrs  ^tn 
aquation  for  tha  blta  for  aach  coafficlant^  la  o’  : tlnad,  l.t. 


J 


1 " 2 
" j«l  J 


(4.3,2) 


Tha  valuaa  for  Bj  (J  ■ l,2,S...n)  datarmlnad  by  (4.3,2)  are  naxt  rounded  to  tha 
naara*t  Integer.  It  can  ba  ahown  that  B^  > Bj  > .•.  > and  should  the  assignmant 
dictated  by  (4.3,2)  not  satisfy  (4.3.1),  some  of  the  ire  adjusted  according  to  tha 
following  rules: 


B 


n 

(1)  If  Mu  < t B,,  taka  that  B, 

® j.l  2 2 

> 1 and  replace  it  by  Bj  >1. 
n 

(2)  If  Mjj  < Bj  , taka  that  Bj 
• B^  and  replace  It  by  B^  ♦ 1. 


corresponding  to  the  largest  J such  that 


corresponding  to  the  smallest  J such  that 


The  above  procedures  constitute  a suboptimum  algorithm  which  provldej  nn  unaqu.il 
Bsalgn.nent  of  Mj^  bits  to  tha  n sampUs. 

Table  4.3.4  indicates  the  bit  assignments  on  the  64  transform  coefficients  using 
this  procedure.  Using  this  procedure,  truncations  of  ths  transform  coefficients  are 
obtained  by  not  assigning  any  bits  to  them.  On  reel  data  euch  ns  the  pictures  used  In 
this  study,  bit  assignments  giving  better  results  than  those  shown  in  Table  ,1.3,3  ere 
obtained.  One  such  variation  is  to  arbitrarily  truncate  the  number  of  coafflrlants 
to  .32  and  then  uaa  the  Wintt  and  Kurtanbach  algorithm  on  thase  32  coefficients. 

The  MSB  obtained  us'ng  this  modified  scheme  urs  given  in  Table  4.3.S  iu>,i  the  bit 
assignments  for  this  case  are  given  In  Table  4.3.6.  It  Is  noted  that  a reduction 
by  an  order  of  magnitude  In  the  MSi;  is  obtained  using  this  procedure.  This  is  dup 
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Bit  Aiiignmonti 
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NDSB 

64  Cuofficiinti 

O.S  b/p 

0.011993 

0.017753 

0.1  1 

1.0  b/p 

O.OOST3I6 

0.0085961 

0.08 

1.5  b/p 

0.0031147 

0.0048886 

0.04 

Ttbl*  4.3.S,  Error!  Uiing  ^todlfltd  Bit  Aiiignmtnts 
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O.S  blti/pel 


1 . 0 blti/pil 


1 .5  blti/ptl 


Tub  I <•  4 , 3 . b 


'''cuiried  bit  Asiigitminti 


to  th»  fact  that  uilng  th«  algor Ithni  on  64  sampler  (ualrig  itn  8 x 6 block)  a sig- 
nificant nunbar  of  eoafflclants  are  kapt  und  assignad  only  ena  bit  which  probably 
doas  littla  to  inprova  tha  parformanca . On  tha  othar  hand,  whin  ona  first  cruncatas 
tha  64  coafficianta  to  tha  32  containing  tha  highast  infnrAatlon  and  than  applias 
tha  bit  assignnant  procadura,  mora  bits  ara  assignad  to  tha  cocfficiants  containing 
tha  most  information. 

Pigs.  4.3.4a«btO,d  and  4,3.Satb,c  ahow  tha  rasultn  obtalnad  using  tiia  two* 
dimansional  lladanard  and  tha  Discrata  Cosina  Transforwations  for  tha  scana  of  tha 
Truck,  Results  ara  shown  tor  0.2S,  0.3,  l.U  and  l.S  ylts/pal.  Sinilar  results 
for  tha  scene  of  tha  Tank  ara  givan  in  Pigs.  4,S,6s,V,c,d  and  4,3.7a,btC.  Rtsulta 
ara  not  givan  using  tha  Hasr  Trtnsfom  sines  ths  psrforsianca  using  this  tachnlqus 
is  asssntially  tquivilant  to  ths  Hadasiard.  In  sll  cssts  tha  qualities  of  ths 
pteturss  obtainsd  using  ths  Diserata  Cosina  ara  supirior  to  thoaa  obtaintd  using 
tha  HsUsmard;  howavar,  tha  cosiputatlonai  raquiraments  of  tha  Diserata  Cotina  art 
mora  compilcctad  thin  thoia  of  tha  Hadaisard,  Tha  musbar  of  computations  (additions) 
raquirad  for  ■ two-dimansional  Hsdanard  ira  »N  logjlN,  whila  for  tha  two-dlmansiunsl 
Diserata  Cosina  tha  numbar  of  computations  rtquirtd  ara  (4N  lo|2  N - 4 N)  multipll- 
oHtioni  and  approximataly  tha  lama  numbar  of  additions  as  for  tha  Hadtmard  trani- 
tormation.  Dua  to  tha  conplaxity  of  tha  Diserata  Coiint  algorlthai,  ths  Hadamsrd 
transfoimicion  in  preftrrad. 

Ona  may  draw  savaral  othar  conclusions  from  tha  plcturts  shown  in  Pigs. 
4,3.4a,b,C|di  4.3.Sa,b,c;  4.3.6a,b,e,d  and  4,3.*a.biC.  Hirst,  it  is  observed  that 
even  at  axtramaly  low  bit  ratas  (0.2S  and  b.S  blri«/pal)  raasonabla  raiulti  sra 
obtalnad.  Tliara  is  soma  loss  of  detallsi  howave.',  tha  results  of  0.2S  blts/pwl 
ara  not  slgnl flrantly  poorer  than  those  obroinej  using  0,5  bjts/pri.  If  ona  esn 
withstand  tha  amount  of  degradation  shown  in  'hast  figures  using  0.J5  or  0.5 
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0,25  0.5 


1,0 


1,5 


Blt#/Pel 


Fig.  4,3,3  reO- F.rrur  Using  2-D  Trunst’orm, 
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4,3,r>a  Two-Dimenalonal  Discrete  Cosine 
Transform  Technique  of  Truck; 
0.5  hits/pel. 


7a  Two-Dimonnlonal  Discrete  Cosine 
Transform  Technitiue  of  Tank; 

0. S bits/pel . 


1S6 


4,5.7b 


TVo-nimpnsionfll  IHsvrt>te*  Cosinp 
Transform  Technique  of  Tnnk; 

I . 0 blts/pcl . 


IS’ 


blts/pel,  then  a substantial  reduction  In  indwldth  can  be  'ihtoined.  Whether  an 
RPV  can  accept  this  amount  of  degradation  depends  on  the  resolution  required 
which  depends  upon  the  many  parameters  of  the  mission.  To  my  knowledge,  no  pre> 
determined  resolution  or  mission  parameters  have  been  specifleu  which  would  ma:<:e 
a "yes''  or  "r.j"  answer  possible.  It  Is  ^'.tlgge8ted  that  suitable  guidelines  or 
limits  be  determined  in  order  to  make  these  judgements. 

Comparing  the  results,  which  are  almost  equ..valsnt,  of  0.25  or  0.5  bits/pel 
with  those  obtained  using  1.0  and  1.5  bits  for  these  pictures  indicate  that  the 
pictures  processed  using  1.0  and  1.5  bits/pel  are  of  significantly  better  quality 
than  those  using  0.25  and  0,5  bits/pel.  Subjectively  it  appears  that  there  is  a 
threshold  type  effect  whereby  the  improvement  due  to  doubling  the  bit  rate  Is 
considerably  better  in  going  from  0.5  to  1.0  bits/pel  than  they  are  in  going 
oither  from  0.2S  to  0.5  or  1.0  to  l.S  blts/pel.  Although  this  threshold  type 
effect  seems  true  from  the  subjective  point  of  view,  it  is  not  noticeable  in  the 
MSF:  measures  given  in  Tables  4,3,3  and  4,3.5.  The  MSB  measures  given  in  Table 
4,3,3a  indicate  that  in  general  the  scene  of  the  "Tank"  gives  signifies  ,iy 
superior  results  than  the  scene  of  the  "Trucf".  This  improvement  is  not  appu.'ent 
subjectively  whan  looking  for  specific  objects  within  the  pictures.  In  particular 
when  we  specify  objects  within  each  picture,  for  oxemple.  the  tank  in  one  picture 
and  a v^heol  on  the  truck  in  the  other,  considerable  dofrat'i.t i ni,  is  seen  ui  I'Oth 
pictures  for  0.23  bits/pel.  The  overall  MfE  mer^surc  doe.i  not  indicate  these 
results  due  to  the  fact  that  relatively  high  MSB  foi  a small  area  does  not  con- 
trlhuto  significantly  to  the  overcll  MSB.  In  otder  ..•»  dttenulne  an  error  measure 
which  would  teiid  to  Indicate  the  degradations  In  areas  of  high  resolution  without 
losertirg  to  a calcul.ntlon  of  MSB  for  some  selected  area  in  n picture,  the  normal- 
Ized-derivati VO- squered -error  [NDSCj  w.rs  ca'cvilated  for  titese  pictures  rmd  the 
results  are  given  Tabli  4,3..3u,  U;  lng  ',hl;,  err'-r  rriicrion  shouM  enhance  the 
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error  at  sharp  tontoiirs  nv  n-jjion:.  of  higl.  .a-tioty  within  tlie  pitturc,  Althojah 
thb  numerical  ^^alues  of  these  errors  are  relatively  high,  they  clo  tend  to  indicate 
Che  same  trend  us  do  subject. ivo  ovalaatlons  In  that  they  do  iadicata  the  threshold 
effect  somewhat  between  0.5  and  l.O  bits/pel. 

I Hybrid  Cod  inn  (Noiseless  Channel) 

In  this  section  we  evaluate  the  performance  of  the  Hybrid  coding  schemes 
described  In  Chapter  lit.  Since  It  has  been  shown  that  the  Transform-DPCM  and 
DPCM-Transform  techniques  are  equivalent  In  performance,  all  results  given  are 
for  the  Trans forffl-DPCM  scheme.  Results  have  also  been  obtained  using  UPCM* 
rr.Tnsform  technique;  however,  they  arc  Identical  to  the  Transforn-DPCM  technique, 
line  can  Interpret  the  same  results  for  eitner  system.  In  tlils  scheme  a one* 
dimensional  Hadnmard  transform,  using  a blocK  site  of  16,  was  used  to  remove  the 
i.orn.' i.it  1011  in  the  horizontal  direction  ami  techniques  are  uicd  In  the 
'.'i.vtical  direvtiou,  ‘iev'eral  v.ii  i.it  ions  ir.  the  lll'cM  stiuctures  were  investigated. 

i '.g,  4,1,1  gives  the  vari.mces  of  the  Hybrid  coding  signal  at  the  Input  to 
t'lv  .;uant  i :v.‘  for  the  six  pictiros.  In  these  simulations  the  prediction  coeffi- 
cients in  me  U^CM  coders  arc  equal  to  the  vertical  corvelotlon  coefficient  of 
tie  picture,  In  this  case  all  of  the  i'l’fM  coi'ers  use  Uie  same  prediction  coeffi- 
cient, but  each  haw  a different  number  of  quantlcatlon  levels.  In  renllty  for 
real  d.ita  the  v*Ttlc;il  correlations  for  oucii  coefficient  will  be  llfferor.t  and 
diftvrent  prediction  coefficients  should  I'v  used  for  an  optimum  system.  However, 
tile  Sim,]  1 icily  gained  by  using  t'nl\-  one  ,'re’! ict  ivin  cos'f f Ic i ent  is  probably  worth 
the  slight  liu  roast'  in  or  or,  I'lh'  u'.d  l.i’'le  4,4.1  show  the  normal  iced 

upu  1 at  I \ ■'Mi'i  ot  I'lo  v.'iri  .in.  e-,  p|  ■ i gn  • 1 ■ it  the  input  tn  tlie  ipi.inti  cer . 

I' . '.tngraris  cf  tile  ilmfironce  ot  the  traiist'orm  i ne  f f Ic  lent  s have  lietui  obtained 
.'.I'd  are  gi'U'n  ■ o .Ippemliir  cl  tbf.  rcjii'r  . Hi  stin'.r.ini'-  of  difference  nf  t iie 
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Fig.  4.4.2.  Cumulative  Sum  of  the  V,?riances  ol  the 
Coding  Samples  at  the  Quanllser  Input. 
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able  4.4.1.  Sonalized  Girsilativs  Sisi  of  Variances  of  Ilybrid 
Codin?  Saaplc  at  input  of  Quantizer. 


t ran  s for  in  co«'.  I luient  s appear  bell  nhaped  f'lr  all  coeffloionts  except  th*t  first. 
The  hl.'itOKram  for  the  first  ooeffUlent  ajtponrs  to  be  coii.pletely  random,  almo -t 
uni  form  In  nature,  Such  chnracterlntlcB  Indicate  the  majority  of  the  Infomatlon 
Is  contained  in  the  differences  of  the  first  coefficients, 

TuDle  shows  the  hit  assignments  ubvalned  using  the  Wlntt-Kurtenbach 

algorithm.  It  has  been  pointed  out  before  that  this  bit  assignment  procedure  for 
real  data  appears  to  be  rather  poor  due  to  the  fact  that  many  unimportant  coeffi* 
cionts  aro  assigned  only  one  bit,  thus  leaving  fewer  bits  for  the  high  infortuition 
c.srrylrg  coefficients.  A computer  search  routine  was  used  to  modify  the  bit 
iirslgnniont  procedure  in  order  to  minimise  the  MSR,  fable  4,4,3  shows  results  fur 
iiuveral  vari.stions  In  the  bit  assignment  procedure.  Table  4,4,4  shows  the  actual 
hit  assignments,  determined  from  this  study,  which  were  used  in  the  simulations, 

i'ahloa  4,'l,.')u,b  und  c show  error  measures  for  the  scenes  of  the  Truck  nnd 
the  Tunk.  Thu  prediction  coefficients  used  In  the  DPCM  coder  were  set  equal  to 
0^.,  the  vertlc.al  correlaf lon.-t  of  the  pictures.  The  MSI  and  NDf)!;  nro  shown  graphi- 
cally In  Pigs,  4.4..3H,b  and  c.  Comparing  the  results  of  Tnble  4,4, S with  those 
,,lven  In  Tablo  4. .4, .4  tor  the  two-dimensional  trantifotms,  it  is  obsurvod  that  the 
liynri.l  coiling  Hchoine  pcTtorms  almost  equivalent  to  the  Discrete  Cosine,  which  is 
• uperliM  to  the  perfurnuncos  of  both  the  tun  d Imensioi.'al  lladaraard  and  Hear  trans- 
Ifm  t.  .■hninno.i, 

I*  t’ln  been  pointi'il  out  in  Chapter  lit  that  using  one-dlmen'.lonal  techniques 
t mii.vi'  till'  roriul  atijM  in  the  horUuntnl  (vertlcol)  direction  does  not  leave 
tin  i HI  ri' l.it  loi.  In  tiu'  vertlciil  fhorlcontnl ) dlroetlon  Intact  as  theory  would 
lucg'.t.  Ilil  i is  1 1 hutr.-.'ed  In  Table  4.4,n  where  wo  show  the  vertical  correla- 
tion ul  the  transt'orm  coefflc’enls,  ITiese  results  Indicate  that  a different 
I"  I’  l I • I in  . nvfl  U- lent  Ml  the  Dl’CM  coder  should  bo  used  for  each  coe  f f l>.  I ent , 


o.s 


1.0 


l.S 


Bltt/Ptl 


FIr.  4. 4,, 1c.  Normal  i.Jd  .'■lo.-in- \h«iohite- 1 rrnr 
(Hybrid  Coding) 


Mpa«-Squar?t!-Frror  Using  Hybrid  Coding  Schc*-- 


tiii'acnt 


• Iu»  MoulU  4 Uit'ta.'viu  (litttli.Uon  -.ocUicivni  tur  cac!’.  IjILM  ..odtr.  I tbit; 

4.4.7  showii  th*  results  ott^air.td  using  ;hi*  scunt;  of  the  laiif  i»h*n  different  pre- 
diction coefficients,  equal  to  the  correlation  coefficients  given  in  Table  4.4.6, 
are  used  in  the  I'PCM  coders.  CoMparing  these  results  with  those  given  in  Table 
4.4,Sa  where  the  saswi  prediction  coefficient  (Aj  • p^.)  is  used  for  all  coeffi- 
cients, there  appears  to  be  little  differences.  This  is  due  to  the  fact  that  the 
performance  of  the  DPCM  coder  la  insensitive  to  the  prediction  coefficient  for 
noiseless  channels.  This  stateswnt  is  not  true  if  noisy  channels  are  assumed. 

Pi|s.  4,4.4e,b,e,d;  4.4.Se,b,c.di  4.4.6s,b,c,di  4,4.7atb|C:  4.4,8a,b,c,d 
and  4.4.9a,b,c,d  show  the  results  obtained  using  Hybrid  techniques  on  the  six 
pictures  for  bit  rates  nf  0.2S,  O.S,  l.o  end  l.S  blts/pel.  In  all  cases  ths 
prediction  coefficient  in  the  OPCM  coders  was  equal  to  the  vertical  corralatton 
soeffictant  of  the  picture.  Comparing  the  picturas  obtained  using  ths  Hybrid 
codint  scheme  with  those  obtained  using  the  two-dimensional  transforms  given  in 
'.he  previous  section,  it  sppesrs  subjectively  that  the  Hybrid  coding  technique 
gives  superior  results  to  the  transform  techniques  except  at  extremely  low  bit 
rntet  uf  0.2S  blts/pel.  At  this  low  hit  rate  there  appears  to  be  noticeably  more 
"bloctvng  effect"  in  the  Hybrid  scheme  than  in  the  two-dlmenalonsl  transform 
:rc,hpi.|iif  , >Mlvh  was  wnexpecttd.  The  ovt’ull  quality  of  the  pictures  obtnlned 
using  the  Hybrid  technique  appears  to  be  somewhat  betTnr  than  that  of  the  two- 
•'inensionsl  transforms,  which  agrees  with  the  MSE  results  given  previously.  One 
noticeable  point  which  is  different  In  the  pictures  processed  using  the  Hybrid 
lojtng  scheoe  is  thet  the  subjective  quality  of  the  pictures  appears  to  improve 
f a linear  sense  ns  the  Mts/pel  arc  in.n . i'hls  was  not  true  for  the 
pivjtures  obtained  using  two-dimensional  transform  techninurs. 
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t'ncff  iclcnt 

I’orro  1 at  ion  j 

1 

0. 

2 

0,64408 

3 

0.46013 

4 

0,S0872 

S 

0,22920 

6 

0.26723 

7 

0,29189 

8 

0.31042 

9 

0.10161 

10 

0.08S60 

11 

0.09810 

13 

0.10369 

13 

0.  U6S8 

14 

0. 10069 

IS 

0.14176 

16 

0.1330 

Tab  la  4.4,6.  Corral  Qtion  of  tha  Trni\.>)  format! 

Coefficients  • Tank  (onp»elentent  ctola^) 


Bits  Per 
Pel 

,Msn 

MSI!  (using 
nil  foiiclback 
factors  ” .95531 

0.2S 

0.045522 

0.04.5915 

0.50 

0.0.32644 

0.034021 

l.O 

0.020409 

0.0:254.S 

, _ . , , » , - . 

— 

Table  4,4  7,  Wean-Stiuared-Brror  for  the  Scene  of  the  Tank 
Using  Trat\iifo.m-nPO<  unci  I’rodicvlon  Coeffi- 
cients as  given  In  Trtl>le  ‘1,4,5, 


4.4.5c  Hybrid  CodiPR  {Trpnsform-DPCM) 
of  the  Scone  of  the  Tank; 

] .0  blts/pel . 
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4.4.6d  Hybrid  Coding  (Transform- DPCMJ 
of  the  Scene  of  the  Trees; 

1 . S bits/pel . 


I 


4.4.7a  Hybrid  Coding  CTranbform-DPCM) 
of  the  Scene  of  the  Field; 

0.25  bits/pel. 
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It  h,i:>  Ih'imi  provu»ii'-.ly  that,  the  M.SI-  ni«nsupu  does  not  ut  times  corroUto 

iiiMi  subifjtt  i'l’  ova  liiai  ions , Thin  is  imrHcuUrly  true  when  one  compares  re'Hilts  of 
vll  rtVroiit  toolin.U(iio'i  tn'  tUft'uu>nt  pictures.  The  MSH  measure  does  seem  to  give  useful 
t'uioilts  when  ooMpii iM soiu  itru  rest t ic.tud  to  the  same  picture  und  the  same  technique. 
Uiti'  in.’tin  lii'iiulviintattc  of  the  MSH  inousuro,  which  has  been  pointed  out  before,  la  its 
In.ihlllty  tn  liKlLcntc  dogriuliitlons  In  nmnti  regions  of  high  resolution  within  n 
)>lctore.  In  order  to  drtenr.lne  the  usefuInesH  of  a purticular  Scheme  several  local 
iviM  int'iin“"in"m'd-‘M’ror  ctilcolrttlons  wore  mndr  for  the  areas  containing  the  tank  and 
nta riicsc  Insults  iirn  given  In  Tnhle  -i.'l.g  for  both  the  Hybrid  technique  and  the 
tw.t-ilimL'nsioiiiil  transform  toohnluuoi. . It  Is  noted  that  local  MSR  fur  both  the  scenes 
01  ihn  "Triich''  and  the  "Tank"  are  cssi'iulul ly  the  same,  which  was  not  true  for  th« 
fotnl  MSli  cnUnilatlons  given  boforo.  The  thi'osiwld  effects  brtwnen  O.R  und  1,0  bits/ 
1 ,1 'n  vi'i'y  ovUlonl  In  tl'oui  n'salts. 

Til'ln  T,.l,!l  compii'o!,  the  resolts  obtained  using  MIXSR,  These  rosvilts  correlate 
M'l'v  nkII  With  tl'.iHi*  obtained  using  the  local  MSH.  This  Indicates  that  tho  NP8B 
I viterlon  wnold  he  n bitter  B«-.sure  ot  "goodness"  of  the  picture  In  tetme  of 
rero  lilt  Ion  In  region.'  of  high  activity  within  the  picture. 

‘ li’Mliu'  r-.'^nlrs  ore  given  In  Pigs.  4.4. Ta  and  4.4,3b  and  Table  4,4,10  for 
. , ' ' . ' |iU  rn;n«,  "'.Ing  thr.'c  rrsuUs  ono  can  dofinltely  nee  the  threshold  etfect 
■ ;v,....n  I’.  . in'  1,||  nit.'/pel.  Below  this  threshold  the  pictures  are  severely 
n-k;.,  a.h.c!  kklii;.'  M'luivv  '.hl'i  Umrsbold  the  plcturus  nro  acceptable. 

'!i,  I Hit-.  I'l'  ihis  inllnn  iiro  Mmiimirl’Oil  biMOW’ 

111  At  ii,".  lad  b-U'w  ilu>  plvtorfs  arv  sevoraly  degraded  In  terms  of 

...  I ll  t 1', 

1 1 1 I Mt,  1 .f  b^■.'ln■|■  ri'Milts  in  pictures  which  are  csseiu  iul  ly 

. I I . ‘ ; I [ ' . . ■ . 1 r I ' I II  1 1 f II  - ■ .!■  I 1 1 1.-  .It.' v;  I ad.  It  I on  I . 


C.3 


(3)  Tne  Hybrid  coding  8cham»'  fjerforms 


fi 

i 


tocbni(]ues . 

(4)  The  icca'  MSH  or  ’.nSE  l8  a better 
inanco  In  terms  ol'  resolution  und  can  be  iisef 
pictures  and  different  processes. 


1 

0.25  b/p 

0.50  b/p 

1 

M 

0.04591S 

0.034021 

1 

1 

2 

0.0d9.50B 

0.062092 

1 

J 

0.062845 

0.038762 

! ^ 

4 

0.123720 

0.085477 

S 

0.078673 

0.046188 

6 

0. 106611 

0.07i)02P 

h 

1,11637 

2 

1.13152 

1.08445 

n 

1.32364 

1.21533 

■M 

4 

1.197S8 

0,15007 

Tl 

5 

1.35000 

1.22964 

1,  M507 

1 . 10.144 

SI 

0.089595 

0.078931 

2 

0.10.^^1il 

(),083'/35 

3 

0.165310 

0. 123457 

2 

4 

0.160493 

0.13355.3 

S 

0. 177666 

0.13401S 

6 

0.1320)0 

0.111120 

Table  4.4.10.  Comparison  ul 
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•luporlor  to  the  two*d itnens Iona  1 transform 


measure  of  c particular  scheme's  perfor- 
ul  in  Interpreting  results  for  different 


1.0 

1.5 

0.022545 

0.015122 

0.0389/9 

0.028699 

0.022145 

0.016898 

0.051024 

0.034726 

0.024358 

0.016l'91 

0.043468 

0.031492 

0.97795 

O.HllOl 

0.86,5  .'6 

Ol  7vS4.31 

0,91.140 

0.78864 

0,!  .5427 

0, 794.59 

U.9193i 

0,78992 

0.8V65S 

0.005048 

O.n.51427 

0.069058 

0.U542S2 

0.096814 

0.079510 

0.105.)89 

), 034037 

0. 101718 

( .080041 

086711 

0 070271 

r.l.\  Plcuires  fllyln-ld  Cud.np) 


''•5  The  Effects  of  Chnnnel  Nolie  on  the  ^l^wo-[ltmen5)onal  Hadamard  Tranaform  and 

Hybrid  CoJ'iri'a  ’I'uchnlquee  ’ ' . 

la  this  section  the  offocts  of  chan.iel  tioli,B  on  both  the  two-dimnnslonal  Hade- 
niiird  Trapsforni  and  Hybrid  Coding  schemes  are  investignted.  The  probabilities  of 
bit  error  used  in  those  investigations  are  .001  and  .Oi.  Ihe  relatively  high  noise 
chnnnel  was  assumed  so  thit  the  effects  of  channel  noise  on  tne  two  techniques  would 
be  readily  apparent,  so  that  comparison  between  the  two  techniaues  in  a noisy  environ- 
ment could  easily  be  made.  The  effects  of  noise  were  simulated  by  calling  a random 
number  from  the  random  number  generator  on  the  digital  computer  and  if  this  number 
exceeded  a predetermined  level  a bit  error  was  assumed. 

T.nble  4.S.1  shows  the  effects  of  channel  errors  on  the  MSB  for  various  bit  rates 
using  two-dimensional  Hadamard  transform.  Figs.  4.S.la,  b and  c show  the  effects  on 
the  scene  of  the  "Tank"  using  a probability  of  bit  error  of  001.  Noticeable  errors 
are  apparent  as  black  or  white  squares  wUblvi  the  picture,  which  ro.sult  when  the  first 
coefficients  hnvo  errors  in  them.  If  one  observes  tlie  pictures  closely  a number  of 
other  errors,  in  form  of  square  blocks,  uf  less  subjective  Jcgradutlon  urn  also 
apparent.  Figs  4.5.2a,  b nnd  c show  the  effects  of  a very  high  probabilUy  of  bit 
error  equal  to  .01.  Even  at  thia  relatively  high  probability  of  bit  error  the  l.n 
bit/pel  picture  still  has  a laign  amount  of  Information  intact.  Subjectively  the 


Bits  Per 
Pel 

MSf 

Bits  in 
Error 

Pels  in 
Error 

Blocks  in 
Error 

Prob.  of 
Bit  Error 

0.23 

0.06494 

67 

67 

66 

lo-' 

O.i 

0.049134 

134 

134 

134 

10-' 

1.0 

0.029275 

274 

274 

270 

10“' 

0.25 

0.1420 

■'78 

724 

674 

10-' 

0.5 

0.1153 

1321 

.1315 

1160 

10-' 

1.0 

0.0906 

2G23 

2606 

1943 

10-' 

Table  4.5.1  'lean-.Squ.TiTj-tirror  for  the  Sctuie  of  the  Tank 
Using  Two-lUmenslonal  Hadamird  Transform. 


4.5.1a  Two-Dimensional  Hac 
Technique  of  the  Sc 
Probability  of  Bit 
0.25  bits/pel. 
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4.S.2a  tVo-Dlmenslonul  Hadamard  IVansform 
Technique  of  the  Scene  of  the  Tank; 
Probability  of  Bit  Error  ■ .01; 

0.25  blta/pel. 


4,S.2b  Two-Pimensional  Hadamard  Transform 
Technique  of  the  Scene  of  the  Tank; 
Probability  of  Bit  Error  ■ .01; 

0.5  bits/pol . 


i 
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Bits  Par 
Pei 

MSB 

Bits  in 
Error 

Pels  in 
Hrror 

Blocks  in 
Error 

Prob.  Qt 
Bit  Brror 

o.as 

fl.0486 

55 

99 

99 

io“5 

Us  r 

0-0153 

134 

134 

134 

lo'^ 

:..o 

0.0277 

173 

•473 

273 

lo-:* 

0.25 

*0.0742 

543 

542 

533 

10“» 

0.50 

0.071? 

1319 

1305 

1274 

1.9 

10  * 

1.0 

0.0735 

2515 

2593 

215 

e*S 

10  * 

TbbU  4.S.2.  M«in*Squar«d-Brror  for  thi  Scont  of  tht 

Tank  Uslne  Hybrid  Coding • 1>ia  Sojno  Prodicron 
Coiffieiont  is  Used  for  Bseh  Cooffieiont. 


offsets  of  ehsnnol  noiso  on  tho  two*dimsnsional  Hsdsinard  trsniform  tochnicius  ssom 
te  b«  rathor  mini.iml 

Tho  offsets  of  ehannol  orrors  on  the  MSB  insasuro  for  tho  Hybrid  roiling  sehomoi 
sre  (<lvnii  in  Tsbls  4.S.2.  it  notod  that  the  MSB  for  ths  Hybrid  coding  tochniquo 
is  SMbstnntinl ly  loss  than  those  tor  tho  two'dlmonslonsl  transform  tochnlquoi  howovni', 
Clio  qualities  of  ths  picturos  obtainod  are  considerably  poorer  than  those  obtained 
using  two-dimensional  Hadamsrd  transform. 

Pigs.  4.S,Sa,b,c  and  a.S.Saib.r  show  those  results.  In  thess  pictursi  a consider- 
able  amount  of  streaking  in  the  vertical  direction  is  noted.  This  is  due  to  th;«  fact 
hat  DPCM  (uding  1».  used  on  the  coefl'icionu  in  tho  vortical  direction  snd  di fferontial 
codirq  is  very  sensitive  to  noise.  Hor  these  results  tho  prediction  coel'flcientt  for 
UPCM  coders  am  the  same  and  they  are  equal  to  the  vortical  correlation  coefficient. 

Table  4.5.3  shows  tho  results  obtolned  u»ing  dlff.ront  prediction  coefficients  for 
the  DPdM  encoder.  'I’heiie  coefficients  are  equal  to  the  calculncod  coriolitions  of 
Irullvldual  transform  coefficients  when  Tronsfiifm-nPCM  coding  is  used.  .Since  no  signi- 
ficant Improvuments  are  seen  pictures  were  not  reproduced  for  those-  cases. 
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4.5.3a  Hybrid  Coding  (Tran* form -DPCM) 
of  the  Scene  of  the  Tank; 
Probability  of  Bit  Error  ■ .001; 
0.2S  Dits/pel. 
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4.5,3c  Hybrid  Coding  (Tnms runn ■ I'I'i'M) 
of  the  Scone  of  rtio  Tnnk; 
Probublllty  of  Hit  liiTor  ■ .iiul 
1 ,0  blt»/|H'l . 
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4.5.4m  Hybrid  Coding  ^T^anifcnIl-DPCM) 
of  the  Scene  of  the  Tank; 
Probability  of  Bit  Krror  • .01; 
0. 25  bita/pel . 
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F 


Bits  Pe.' 
Pol. 

MS.-; 

Bits  in 
Error 

Pels  111 

iirror 



Blocks  in 
Error 

Prob.  of 
Bit  Error 

0.23 

0.0531 

59 

59 

59 

lo'^ 

0.50 

0.041P 

134 

134 

134 

10-3 

1.0 

0.U2H0 

273 

27  3 

273 

10-3 

0.25 

0.1062 

645 

642 

G35 

10-3 

0.50 

0,0966 

1319 

1306 

1S74 

10-3 

1.0 

0.0946 

261Q 

2593 

2'U.6 

10“3 

Table  4.5.5.  Mean-Squarad-Error  for  thd  Scene  of  the 
Tank  Using  lybrid  Coding.  A Different 
Prediction  Coefficiunt  is  Usid  for  Each 
Coefficlff  t. 

In  the  next  section  optlmir.itlon  ol‘  the  Hybrid  coding  schemes  in  order  to 
reduce  the  disastrous  effects  of  channel  noise  is  considered. 

* ■ Optiinir.ation  of  The  Myiirid  Codin.i  Scheme 

Husults  of  the  previous  section  have  indicated  the  sensitivity  of  the  Hybrid 
coding  scheme.*  to  noisy  channel.  This  was  f).xpected  using  differential  encoding. 

/n  this  faction  results  are  given  using  an  optlmited  system. 

T.ie  prodlcclon  coefflclonts  were  optimized  taking  into  account  the  channel 
nolso  as  described  theoretically  in  Chapter  III.  Fig.  1.6.1  shows  plots  of  the 
optimum  predicticn  coefficient  ns  a function  of  the  number  of  birs/pel.  Tnese 
curves  show  that  as  the  channal  noise  increases  the  prediction  coefficient  de> 
croasos,  This  is  to  be  expected  since  a lower  value  for  the  prediction  coeffi- 
cient will  allow  any  error  to  die  out.  .Slroll.ar  iC;<Llt3  have  been  obtained 
previously  for  ono-dlmenslonal  OPCM  by  F.>-smBn  and  Wlntz  [.15H.I,  Table  4.(i,l  and 
Fig.  1.6.2  show  the  MdF  ootnined  u.slng  tiu-  optimum  prediction  coefficients.  Com- 
paring thei.'o  re.uilts  wifti  those  glv-ui  in  tbp  pi'evious  :.e.:tion.  It  appe.i’u.  t'-'Sing 
the  M.Sf:  measure)  that  there  is  little  Lnprovenent . Suhl  ect  i ve  1 y , the  tinprovonents 


1 1 


o.o: 


0.06 


0.0S4- 


0.04 


0.03' 


0.02 


Mon-0ptimam(PE**10  ) 


\ 


\ 


\ 


OptimuinCPE-lo"  ) 


Non-0ptlmur.C?R*10*") 


-3^ 


Optimum  (PE^lfl  ) 


+ 


+ 


■ ■ ■ - 

l.o  B'lts/Pfll 


0.25  0.5 

Fist.  ^..6.2.  Mean-Squared-EtTor  Using  Optimum  Prediction  Coeificlent. 
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Average 

Bit/Pal 

ft  •'  0.05*131 

Optimum 
A*  B 

o.us 

0.048S9S 

0.047725 

's 

0.30 

0.038294 

0.036299 

04 

1,0 

0.027681 

0.02S13B 

(N 

0.23 

0.074222 

0.057805 

's 

0.50 

0.061200 

0.048775 

£ 

1.0 

0.073664 

0.039698 

Table  The  Effects  of  Using  Optimum  Prudictlon 

Coefficients  in  the  Tranai’orm-DPCM  System 
for  the  Scene  of  the  "Tank". 


ue  high  noise  levels  are  substantial,  These  improvements  can  be  seen  by  comparing 
Figs.  4.S,4aib,c  with  Figs.  4.6.ia,b,c,  It  is  observed  that  at  high  bit-error 
I. tea  C<01)  the  streaking  is  significantly  reduced  (see  Figs.  4,5.4c  and  d.'j.dc), 
The  improvements  at  lower  error  rates  are  not  os  apparent.  Since  it  has  been 
shown  that  the  picture  quality  is  insensitive  to  the  prediction  coefficients  for 
a noiseless  channel,  the  use  of  .he  optimum  prediction  coefficients  would  not 
substantially  degrade  the  picture  quality  even  foi'  noii/'<]css  channel.. 

Comparing  Figs.  4.5.2a,b,c,  which  are  pictures  ,-htained  using  the  two- 
dimensional  Hadamard  transform,  with  the  results  given  In  Figs.  4.(j,4a,b,c  for 
the  Hybrid  coding  scheme,  it  is  seen  that  using  the  optin.lrrd  prediction  coeffi- 
cients, subjectively,  gives  essentially  equivalent  results  as  the  transform 
method;  although  the  MSE  using  the  Hybrid  coding  schemes  is  considerably  less. 

One  of  the  moan  disadvantages  of  the  Hybrid  coding  techniques  1;  its 
sensitivity  to  noise.  Using  the  optimum  prediction  coefficients  In  the  DPCM 
coders  alleviates  this  to  a certain  extent.  Ihir.  optimiiatlon  scheme  basically 
reduces  the  prediction  coefficients  so  that  the  errors  can  damp  out  more  rapidly. 

2\') 


.OkiAMuaiaki 


4. 6.3b 


Hybri.:  Codii 
of  the  Scen< 
Optimum  Pre( 
Probability 
0.5  bits/pei 


4.6.3c  Hybrid  Coding  (Trans form- DPCM) 
of  the  Scene  of  the  Tank  Using 
Optimum  Prediction  Coefficient; 
Probability  of  Error  ■ .001; 

1.0  bits/pel. 
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4,6.4b  Hybrid  Coding  (Trans form- DPCM) 
of  the  Scene  of  the  Tank  Using 
Optimum  Prediction  Coefficient; 
Probability  of  Error  ■ .01; 

0,5  bits/pel. 
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Ir  it  th^  propugation  of  arrorn  In  tho  tU fferontla'  encoding  Kuhenc  which  cauien 
tiie  Mvare  streaking  In  tha  plcturos.  Porludlc  rotattlng  or  Inltlsl.'iatlon  can 
ba  usad  affactlvaly  to  ramady  tha  propagation  of  arrora  In  UPCM, 

Pigs.  4.6.6a)btC  and  4i6.7a|b|C  show  tha  affects  of  rasatting  tha  DPCM  procoss 
aftar  avrry  16  Unas  for  probability  of  arrors  of  .001  and  0,01  rsupacrivaly . Pigs, 
4.6,8aih  and  4,6,ga|b,e  show  tha  rasult  obtained  If  tha  parlodlc  rasattlngt  are 
dona  ovary  32  Unas.  In  all  casas  tha  optiitum  preuiccion  coofflclants  wars  uiod. 
Consldarabla  improvamanti  In  picture  quaUt<aa  when  channal  tiolso  is  prasant  are 
obtained  using  tha  periodic  ratal  ng  technique,  Tha  ratultt  of  those  pictures  are 
superior  to  those  using  tho  transforn  ‘■tchniquas  in  tho  presanca  of  channal  noise. 
Since  most  of  tho  information  it  contained  in  tha  first  cuaffielcntt  errors 
In  this  eoaffloiant  would  have  significant  affect  on  pietura  qunlity,  The  use  of 
error  corraeting  cudinq  on  tha  important  coefficients  \ould  bo  .idvnntagaous.  Pigs 
4,6,10atb,c  and  4,6,lla,b  show  results  oituming  error  corr''ctlng  coding  on  the 
first  coefficient  for  probability  of  hit  arrori  of  0,oni  iind  O.OI  respei lively , 

The  hits/pel  specified  on  thnie  plcturei  do  not  Inclocle  the  bltr  required  for  the 
error  correction!  however,  since  only  tha  first  coefficient  Is  assumed  to  he  coded 
In  this  manner  tha  average  bits/pel  will  not  change  stgniflcsnily.  Por  tha  result') 
shown  In  thasa  figures  no  periodic  raselting  was  done!  however,  the  optlmuin  predli- 
tlon  coafflclenis  were  used  in  tha  DPCM  coders,  Tho  results  ate  seen  to  be  algnlH 
csnrly  better  than  these  obtained  using  onlv  the  optimum  prediction  coefficient  hi 
however,  they  are  poorer  tnan  thoae  obtained  using  periodic  resetting. 

Figs.  >*.6,lJa,b,c  and  4,6.l.3a,b,c  show  tna  effects  of  using  n prelicdon  coeiii 
dent  of  O.S,  This  was  an  arbitrary  choice  to  see  the  affects  on  picture  quHilty. 
Using  such  a low  value  for  the  prediction  cuef*.clerit  ellmlnutes  h consldurahle 
ssount  of  tha  strooklng  wh'ch  occurs  when  either  optimum  noii-ivilse  or  rpt Imum-iinl 


llyliriil  (\iiiing  Scheme  Using 
rprldillc  Pescttlng;  N » 16; 
I’rohalii  1 I ty  of  lirroi-  ■ ,001; 
o.'i  oita/pel. 


^ ■ V, 


Hybrid  C.oding  Scheme  Using 
I’pflodlc  Resetting;  N ■ 16; 
rrobalii  I Ity  of  Hrror  ■ .01; 
0. 2S  blts/pel. 


4.6.7b  Hybrid  Coding  Scheme  Using 
Periodic  Resetting:  N »=  16; 
Probability  of  Hrror  ■ .01; 
0.5  bits/pel , 


4,6.7c  Hybrid  Coding  Scheme  Using 
Periodic  Resetting;  N ■ 16; 

Probability  of  Error  • .01;  I 

1.0  blts/pel.  i 


! 

I 


4.t).8a  Hybrid  Coding  Scheme  Using 
Periodic  Resetting;  N ■ 32; 
Probability  of  Error  ■ .001; 
0.2S  bits/pel. 


4.6,8b  HybrJ'i  Coding  Schome  Using 
Periodic  Resetting;  N ■ 32; 
Probability  of  Error  ■ .001; 
O.S  biti>/pel. 


4,6  9a  Hybrid  Coding  Scheme  Using 
Periodic  Resetting;  N ■ 32 
Probability  oi  Error  ■ .01 
0,25  bits/pel. 
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0.5  blt*/p«l. 


j 


4.6.11b  Hybrid  Coding  Scneme  Using  Error 

Correcting  Code  on  First  Coefficient; 
Probability  of  Error  ■ .01; 

1 . 0 bits/pel . 


4.6.12a 


Hybrid  Coding  Scheme  UsUig 
Prediction  Coofflclont  ol 
0.5  (Non-O\itlnuim); 
Prnhablllty  of  Hrrov  • ."'n. 


0.2S  blt»/pcl- 


i 


I 
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4.6.12b 


Hybrid  Coding  Scheme  Using 
Prediction  Coefficient  of 
0.5  (Non-Optimum); 
Probability  of  Error  " .001; 
O.S  bits/pel . 
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4.6.12c  Hybrid  Coding  Scheme  U^lng 
Prediction  Coefficient  of 
0.5  (Non-Optimum); 
Probability  of  Error  » 001; 

ro  bits/pel. 
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4.6.13b  Hybrid  Coding  Scheme  Using 
Prediction  Coefficient  of 
0.5  (Non-O|)tlmum) 
Probability  of  Error  ■ .01; 
0.5  bits/pel. 


prediction  coefficients  are  used  (see  Pljs.  4.5,3a,b,c  and  4.6.3a,b,c).  The  picture 
quality  Is  not  substantially  reduced, 

Figs  4,6,14a,b,c  and  4,6,lSa,b,c  show  the  effects  of  using  a value  for  all 
predictioi.  coefficients  equal  to  the  vertical  correlation  of  the  picture  and 
assuming  error  correcting  coding  on  the  first  coefficient, 

Table  4,6,2  compares  the  MSB  for  the  various  techulquei  used  in  these  invest!- 
gutions.  The  results  and  conclusious  about  Hybrid  Coding  Schemes  are  siunmarited 
below: 

(1)  The  picture  quality  is  very  insensitive  to  the  prediction  coefficient 
except  for  the  ease  of  noisy  channel,  in  these  caser  a low  value  for  the  prediction 
coefficient  should  be  used. 

(2)  The  MSB  does  depend  on  the  prediction  coefficients  end  indicates  at 
tines  ths  opposite  conclusions  than  subjective  evaluations, 

(3)  The  Hybrid  coding  scheites  can  he  designed  to  out  perform  two-dltnsnsional 
transform  techniques  even  when  cha.mel  noise  is  considered, 

(4j  Periodic  resetting  urrng  the  optlmun  prediction  coefficient  gives  superior 
romlts  than  all  other  techniques. 

(5)  Error  correcting  coding  on  tho  first  coef ■’iciont  Is  effect  1'’#  in  inprovlnf 
the  results  in  the  noisy  channel  case. 
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4.6.14c  Hybrid  Coding  Scheme  Uelnji  lirror 
Correcting  Code  on  I'lrut 
Coefficient;  All  A ■ p \ 
Probeblllty  of  I'.rror  ••  .001; 

1 .0  hltn/pel . 


2S1 


4.6.  ISb  Hybrid  Coding  Sthenifl  Using  Error 
Correcting  Code  on  First 
Coefficient;  All  A » p ; 
Probability  of  Error  “^.01; 

0.5  blts/pol. 
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CMAPTRI'  V 


2-D  TR/VNSFORM  WITH  ADAPTIVE  QUANTIZATION 


5. I Introduction 

Tn  this  sactlon  wa  do*crl'j«  and  tvaluute  the  performance  of  the  two-ilimeiiaional 
transform  taehniqua  using  adaptive  quantiintlnn.  In  a tyr^lcnl  t» o-dlmensi onal 
transform  .ayston  the  procass  is  to  compute  the  transform  of  a sub-image  of  size 
II  X n,  resulting  in  coafficlents.  Redundancy  reduction  Is  nchieved  by  cllmlnntlnf 
all  but  the  M most  important  coefficients,  These  coefficients  nre  quantized  and 
codJii  by  soma  type  of  "optimum"  coders  which  are  matched  to  the  staristl^s  ot  the 
coefficients.  For  sequency  type  transformations  tl.o  v,irlanccs  of  the  coeff  Icleni 
:t.jcrcai«  thus  pacliing  most  of  the  information  In  the  low-sequvncy  coeffli.  lunf.  ,uid 
the  nui,it?er  of  qua.itizatlon  levels  used  to  quantize  each  coefficUf.it  dfcrciisDs  wirh 
.'cr;Msin;j  varlunce.  For  this  type  of  rperition  t!)e  ivimiier  of  u>i,uit  I u*  C'l  req.;  i 
v-iU  be  the  same  as  the  number  of  coeffielonts  retained.  In  gciiernl,  the  (|uatii  1 .'er. 
are  ar.wimed  fixed  and  the  design  of  each  quantizer  is  based  on  the  nverage  .tati-ti,' 
over  u laig.«  number  of  pictures,  This  type  of  procedure  performs  '.at , fa,. loi'i  > y ,'H 
the  nv'.-.tge;  lie«e«i,  the  -luiint  i rut  I on  wroi  ce)  ho  rtinlively  l.irg>  in  icp,  or  o: 
high  activity,  resulting  in  a conaideraHlu  loss  of  resolution.  Un  t'.i..<  other  hand 
if  one  de;il'’ns  fixed  q-aanrlzers  based  on  regions  of  high  eztlvlty  within  the  lir.age, 
then  coefficients  in  regions  of  low  activity  (zoiistont  intensity  levels)  are  u'l.'n 
tizfd  with  more  accuracy  than  Is  required,  thus  reducing  the  overall  rodiict  Inn  r.i;u.' 
n tf  ad.ijiiivc  system  shown  in  Fig.  5.1. 1 is  propo.ci’.  as  n relarively  Himplf  ichPiiu’ 
tor  improving  r< solution  In  regions  of  high  nciivity  within  the  imige, 

Iti  operation,  the  block  tr.ins forma, ion  and  trunciitlen  ,irocedure',  are  the  lami* 


as  G convenLlofial  two-dlmen’.tinnal  scheiii*  r-.'s.ilt  in,;  in  M coefficients  wlil-li  nre 


deemed  iiuft'lcient  for  the  quality’  of  plctuio  dusured,  (n  ii  conv«ntionnl  iian-udaptive 
system,  these  coefficients  would  bo  quantised  using  different  nuirb-jr  of  quantlzatloii 
levels  for  each  coefficient  depending  on  the  vartances.  Using  fixed  quantizers  this 
procedure  results  In  only  an  average  approximation  to  the  'optimum"  quantizer  as 
Indicated  balorc.  tn  the  proposed  system  shown  in  Pig.  li.l.l  tho  varluncus  of  ouch 
coefficient  are  continuously  estimated  using  K previous  samples  l.e. 


I 

K 


K 

r 

p*  i 


P 


(5.1.1) 


where  i uenotes  the  coefficient,  These  estimates  of  the  variances  of  the  coeffi* 
dents  are  used  to  normalize  the  coefficients  before  quantization,  thua  resulting 
in  a better  "match"  of  tho  signal  to  the  quantizer.  The  rapidity  of  tho  uduptntion 
algorithm  depends  on  the  number  of  saiuplus  (K)  used  In  estimating  the  vnrUnveu. 

For  active  regions  in  the  Image  o small  value  of  K may  he  deslrablei  however,  too 
small  of  K will  result  in  considerable  error  In  ostlmntlon  uf  tho  varlanco,  thus 
resulting  in  degradation  of  the  compressed  picture.  Using  such  a technique  ns 
described  a'ljve  requires,  of  course,  transralsalnn  of  information  to  the  receiver 
of  the  vrr'ur.'-.es  or  standard  deviations  of  the  ror fflcirnts. 

It  ls  the  purpose  uf  this  chapto,  to  .nvestlgaie  the  porformancu  of  the  ndup- 
live  system  along  wltn  various  tradeoffs  in  terms  of  system  complexity,  bit  reduc- 
tion ratio,  etc. 


5 , 2 Two-Dimensional  Hadamard  Using  .IH-Coefflclents 

Normalization  of  tho  transform  cocfflcleniii  .md  using  the  ’.omr  qviant*:o-  for 
.nil  cocfflclunts  would  rosult  in  u considerable  reduction  of  hardware  required; 
however,  the  resulting  picture  would  be  conslJoral.ly  degraded  using  ri.xod  quantizers. 


;r,v 


It  U of  interest  to  in' L'stlgato  the  possltiiUty  of  using  the  adaptive  scheme  using 
only  one  quantiser  for  all  the  coefficients  and  to  compare  this  system  with  differ- 
ent bit  assignments  for  each  coefficient,  hor  this  inv''st  1 giitlon  we  keep  the  32- 
coefficients  with  the  highest  energy  content  rather  than  letting  the  bit  assignment 
algorithm  truncate  the  coefficients  as  was  done  in  Cahpter  IV. 

Thla  normalization  pvoendure  was  simulated  for  the  picture  of  the  "Truck"  using 
a 4-bic  exponential  quantizer  and  the  Max's  tl37]  4-bit  quentlzeri  The  results  of 
these  simulations  are  given  in  Table  S.2.I. 


Ma.t  (Ju.antlcor 

lixpanentlal  ()uiinti:e.’ 

MSf 

,0046177  j 

.D047S.3 

MUSI: 

,00610(13  1 

.d03lhd)H 

TaMo  1,2.1.  Mi'an-Snuarvd  l i'rur  and  Mimn-Dvrlvatlvu- 
Squarcil -llrrur  for  the  Seme  of  the  Truck, 


lor  I'lnipari'nin  piirposo'.  ihc  Int  \ ipv^ont  pr'ii-cdur"  used  In  illvipter  !v  was 
the  tit.il  number  of  i oel'f  i r lenl  • in  |u  instead  of  (.1 
I's  p. Lilted  OMI.  Ill  Chapter  IV  uhuik  the  tutai  mniiher  of  coeff  i c 1 1 nt  s as  .12  and 
.'Pplvlnyi  th»  hit  nsslumtumt  rule  d'serlhed  in  iTtapter  IV  results  in  a lediutloii  the 
M:d  hy  an  order  ot  inamiltude.  Hils  is  to  he  e.\pected  since  hv  arhltrar',  h truncating 
r|i.'  niiiitlier  ot  cue  tf  1 e I eiit :»  to  .12  results  in  more  hits  helng  .issiiined  to  the  most 
liiiportiint  coefflc.lent'i . Using  the  hit  iis'ilgnment  algorithm  on  (il  coefficleius  is 
'<as  done  In  t.liajitet  IV  results  In  several  high  ordor  coefficients  lioleg  assigned 
I or  d hit',  ivhlch  uoes  not  coi,rrllnit.e  slitiuficiint  l>  to  the  picture  qual'ty. 

2 'i.nieh  lots  heen  prisente.l  in  Uhai'ter  IVl  show,  the  hit  ,i  ss  I gnment  ;i 
■I-. 'I  for  elTi'etlve  Mr  rates  of  o.;, , | , it  nnd  1 . hits/piil,  Tahle  ."i . 2 . t ihows  the 


0.5  blt»/p«l 


l.O  l'U»/p»l 


1 .5  hU»/pel 


TiiliU'  lilt  As  .(I  tinmen  ts  INlnn  Total  CoutTK- ients  , 


iTiMi'A  I'l'tii iiR'il  nsititi  this  |»i oci'tlii'-i’  iU'm>:  with  thv  i rrttr  oht.ilni’il  itslnu  lit  uiit 

Olid  luttlnn  the  lilt  ass  iiiniriMit  algorithm  t riint;<it  r tin  mimhor  ot  toofl  u- mnt  ■ t.t» 
dune  In  Oiiipter  It'.  A runs  Ule  rah  In  dpcea -i'  In  the  total  MSI'  I-  ni'ti.'d 

Ti.-t  Additive  .i'.U'J.  ^tlim  hs  inji  [hit*  I r.er 

la  this  section  wm  eviiluate  the  I'erformance  iisIiik  ono  i|iiuntlcar  which  Is  adjusted 
I))'  the  adaptation  ulitorlthm  descrlhed  oorller.  A*  was  mentioned  before  the  variances 
or  the  itandiird  deviation  of  each  coefficient  are  eHtlmateu  from  the  K previous  co- 
efficii'Mls  .ind  tlii'si'  cst  iitiati’s  are  iis,-d  to  iiormali;c  the  coefficients  TabU 
'how.i  till;  I’i’siilts  ohi.iliH'il  iis|r.);  v.irUi'.  iuiihIhm'  ; o'c  1 1 1 1 I ont  !■  for  v- 1 1 m.i  M na  toe 
v.irliiHc  I'lir  these  slirulat  ionv  a 1 hit  i i|'o'oMit  i al  luaiitlcer  w.is  used. 


MSfi  froiB 
Chapter 


Siimiil  i* 
Sica 

MSK 

Musn 

>l 

' ' ' 

0.015*169 

0, .57513 

K. 

0. 008.11  24 

0.57259 

3d 

0.00592*J7 

0.54978 

ftd 

0.0060447 

0.55245 

I2H 

0.0060791 

0.55104 

;S6 

0.0000519 

0.54845 

Tabic  S.3.1.  Thu  liffocts  of  Satnple-Vlte  In  fatlmatkni; 
the  V.irtanco  of  the  C»ef f Iclanis . 


A problam  axlsts  using  simII  tt^pU  situs  whun  thu  intensity  Uvul  is  usiun* 
tltlly  conatunt.  In  this  cast  thu  ustinttud  varlancu  will  bu  turo  which  would 
c>'uje  u numalization  prchlum.  This  sltuttloti  was  uncounturuii  using  suiplu  situs 
of  8 aiul  lb  in  the  simulations.  This  situation  could  be  remudivd  by  aevcrnl  teen- 
nlquos,  such  as  using  a diffurunt  "activity"  isuasure  or  using  souu  pruduteniinud 
iUgorith'n  \iscd  In  these  casus  woe  to  initi»llte  the  standard  deviation  to  on* 
ond  then  to  increase  it  by  on*  until  the  coufficiont  fvll  within  vh*  .juantiters 

VJIIgO. 

Using  too  large  of  n sample  site  in  estimating  the  vari  in.:e  will  result  in 
lictlu  ur  no  iidaptnt ion  characteristlrs.  The  results  of  Tcble  5.3.1  indicate  that 
(i  sample  si**  of  3J  would  ^ive  the  heit  results. 

Ilusuits  using  a sample  >l:n  of  .3d  for  estirating  the  variance  and  a cosimon 
i<i>it  exponential  ^uantite^  for  each  co«tfi..lent  and  bit  assignments  according  to 
the  Wintt  Kurtenii'ul'  (ugorlthm  iTill  for  the  3,'  esilrMtss  nf  t!)**  standard  deviation 
arc  given  in  lable  '''..3,’,  llie  Mg  assignments  usuil  are  show),  in  lable  5,3.3 
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i;fU'itiv*.  lilts 

1 t'fi.,.  t 1 ve  !'  1 1 R.it  0 

i ijned  U)  1 s t i wilt 0 

Must; 

"i 

t'.Tt 

'“TiTobi 

" 0. s'ryiis'' ' 

A 

.'.0 

O.Oi)bU.3Dl 

o.s.vy? 

U 

...  . . 

3.0 

. 0.00b0?:4 

0.S49I5 

i.iiilo  S..S  lii'rxr  Meiuui'u;  lislnn  ii  C.ohifcon  Quantiser  for 
The  Cue Tf tenants  and  Difr'crent  Quantisers 
for  Ihe  listimatcs  of  Tlie  Stondurd  Deviations. 
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reMiltN  ii'tlti'i/ic  thnt  this  siniLim*.  uuulJ  hr  oi'  linir  i'»i'  for 
coKiproikHian  iind  urr  oidy  kns'ludod  for  i-onoU-Jcrvss 

5.4  ItlT'  I'nijiullnK^  of  Oir  >4tti»atvs  of  Ihr  Varlnnci* 

!n  uri'tton  m<-  tnvont inatv  tlit  multi.  olituliir<>  u»in)t  <! i f forriti  i«l  rnci>ilin)( 

111  thf  c»il'*atps  ot  ihr  vuriancr  ami  ustnK  itifi'rrert  truant  t. its  for  rich  of  the 
uooff lcl«nts 

Plli-  5.'t.l  shows  tlia  autocorrolai  Ion  of  tht  vsrisncr  tsll*.urs  fci  corfflclrnt 
op«  ustnn  kltffartnt  sMple  sktrs  for  cstl»atln|  ths  variances  of  thr  cooffirlents 
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for  coatl'lclu.uu  1 through  4 rcfspeccivaly , Thnse  are  to  be  compared  with  the  hiato- 
gtans  of  the  estimates  of  variances  shown  in  Fig.  5,4.15  [shown  for  coefficient  1 
only) . 

Simuiatlon  vesults  were  obtained  for  the  scant  of  the  "Truck"  using  a sample 
si:o  of  .12  for  ostlmating  the  variances,  A two-dimensional  Hadamard  Transform«itlon 
was  perforiiiod  cm  a block  size  of  8 x S,  resulting  In  64  coefficients.  The  trans- 
form coefficients  were  arbitrarily  truncated  to  the  32  containing  the  most  informa- 
tion and  then  the  Wlntt-Kurtenbach  bit  assignment  algorithm  applied  to  these 
remaining  14  coefficients,  DPCM  encoding  was  used  on  the  estimates  of  the  standard 
deviations.  Only  one  DPCM  encoder  was  used  to  encode  the  est.^ mates  of  the  standard 
de/lat.luns;  however,  in  this  simple  aystem  it  is  necesaary  to  t.*ansmit  32  additional 
places  of  Information  regarding  the  estimates  of  the  standard  deviations. 


Table  5,4.1  shows  these  results  in  tabulated  form.  Also  shown  in  this  Table  are 
i.be  results  obriined  using  the  non-«daptive  two-dimensional  Hada.iiard  tranaform  scheme, 


lMCS/p(.M  for 
Inruns  i ty 

Bits  for 

Differential  lincoding 
of  S.l).  Ilstlnmtos 

Effective 
Bit  Rate 

MSP. 

NDSH 

(1 . .A 

1 

1.5 

0.010279 

0.90194 

(0.0.,J530) 

(0.50030) 

'1.5 

2 

2.5 

0.015188 

0.83545 

n . s 

1 

3.5 

n.cN.s.'t 

O.IICU'1 

1 0 

1 

2.0 

0.008'486 

0.752U 

1.0 

2 

3.0 

0.0083825 

0.71167 

3 

4.0 

0.007802 

0.69896 

1 

1 . r. 

1 

2.5 

C.  0050,18.1 

0.56272 

1.:. 

2 

3.5 

0.00478’D 

0.55775 

1 .3 

.1 

4.5 

0. 004 2114 

O.S4Iu5 

Table  5.4.1.  Simulation  Results  Using  Adaptive  Scheme 
For  The  Scene  uf  The  "Truck" 
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Figs.  S.'i,16  tl. rough  S.4,27  show  j'hotograph.s  of  truck  using  tht  adaptivo 
scheme.  Those  pictures  are  to  be  compared  with  the  non-adaptive  results  given 
In  Chapter  IV,  Significant  improvuraonts  are  noted  using  the  adaptive  scheme. 

For  example  if  we  compare  the  cases  of  approximately  0.5  bits  per  picture  element 
using  the  adaptive  technique  shown  in  Fig.  5.4.24  with  the  non>adaptive  case  in 
Fig,  4,3.4b,  wt  see  that  the  adaptive  ca.se  is  superior.  Similar  results  are 
observed  for  the  1.  hit/pel  case. 

The  preliminary  investigations  gi'*en  hero  for  the  adaptive  scheme  seem  to 
indicate  chat  it  has  merle  and  probably  should  be  investig.ited  more  thoroughly. 


THO 


5,4.16  Two-dimensional  Hadamard  transform 
with  zonal  filtering  using  the 
exponential  quantizer.  4 bits/pel. 
32  retained  coefficients. 


5.4.17  Two-dimensional  Hadamard  transform 

with  zonal  filtering  and  PCM  encoding. 
Different  bit  assignments  from 
chapter  4.  32  retained  coefficients. 

l.S  bits/pel. 
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Two-dimen8ion»l  Hadamard  tratvaform 
with  zonal  filtering  and  PCM  encoding 
Different  bit  aeeignments  from 
chapter  4.  32  retained  coefficients. 

1,0  blts/pel. 


5.4.19  Two-dim«n8ion«l  Hadamard  transform 

with  lonal  filtering  and  PCM  encoding. 
Different  bit  assignments  from 
chapter  4.  20  retained  coefficients. 

0.5  bits/pel. 


t 


IL 


2B4 


S.4.22  Two-dim«naion«l  Hadunard  tranaform 
with  lonal  filtering  and  DPCM 
encoding.  1.0  bita/pel,  Adaptive 
algorithm  on  20  retained  coefflcienta. 


i 


I 


S,4,25  Two-dim«nilon«l  Htdamard  trtniform 
with  zonal  flltarlng  and  adaptlv* 
dlffarentlal  aneodlng  on  c^,  C2 
and  C3  only.  20  coofficlanta 
ratainod.  0.554(>9  blta/pal. 
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Two -dlm«ni tonal  Hadamard  transform 
with  tonal  filtaring  and  adaptive 
differential  encoding  on  8 
coefficients.  12  retained 
coefficients.  0.5  blts/pel. 


5.4. 2B  Two-dlmanslcnal  Htdtmard  tranafortii 

with  zonr.l  filtering  and  differential 
encoding.  11  retained  coefficient^ 

11  adaptive  coefficients. 

2 blta/dlff.  Average  bit 
assignment!  1.0625  blts/pel. 


S . 5 Variations  In  Adaptive  Scheme  nnd  Rucoininendatlona  for  Further  tnvosclmtlona . 

T)io  results  given  in  Section  S.4  relied  on  assigning  at  least  one  bit  1‘or  encoding 
the  difference  in  the  ostlmatos  of  the  standard  deviations.  Using  this  scheme  and 
an  average  of  C.5  bits  to  encode  the  coefficients  results  In  an  average  of  l.S  blts/pel 
for  the  effective  bit  rate.  Several  variations  in  the  scheme  could  ho  tried  .111011  as 
using  a bit  assignment  procedure  to  encode  the  differences  in  the  standard  deviations. 
Tnis  would  result  In  truncating  some  of  the  estimates  and  transmitting  only  the  impor- 
tant ones. 

In  ordev  to  i.ee  what  effects  such  a procedure  .vould  have  on  the  error,  ..everil 
si.nulatlons  were  performed  using  adaptation  on  only  tht  first  few  coefficients.  'Flin.-e 
results  are  shown  in  Table  5.S.I. 


‘"““‘WumSor  0? 
Coefficients 
Using  the 
Adaptive  Scheme 

Average  Bits 
Assigned 
to  Transform 
Coefficient 

Bits  Assigned 
to  the  Differ- 
ence 01  the 
estimate 

ntfactive 
Bit  Rate 

u: 

— 

1 

•Nnsf'. 

1 

.5 

1,0 

U.51S6 

0.011860 

o.bisfi’s 

1 and  2 

.5 

1 0 

0,5.3125 

0.0113(i7 

0,33463 

1,  2 and  .3 

,5 

l.O 

0.. 5437,5 

0.0119 

0,8,  601 

Table  d.5.1.  Results  Usl.ig  the  Adaptive  Scheme  on 
Only  The  fir.st  Fi-w  'Coefficients. 


It  is  seen  from  tlu.se  results  that  using  the  adaptive  feature  on  only  the  tlrst 
fo.v  most  important  terms  give  equivalent  and  as  a matter  of  fact  .'lightly  better 
results  than  those  obtained  In  the  previous  sec!  Ion  (see  Table  5.4. 1).  ’Ihls  is  due 
to  the  fact  that  using  only  32  samples  to  estimate  the  stondard  deviations  can  result 
in  error  as  e.xpiained  before  and  thus  It  Is  entirely  pos.slblu  that  using  the  adaptive 
feature  on  the  lower  and  more  int'crmatlon  carrying  coerficients  could  result  in  less 


2'J.l 


error. 


Tile  results  given  In  this  chapter  are  fav  from  conclurlve.  Tiie  study  of  the 
adaptive  schema  was  inltlaUzed  during  the  last  month  of  the  contract  which  did  not 
leave  sufficient  time  ft r complete  thooreticnl  and  experimental  investigations 
Even  with  the  preliminary  results  obtained  thus  far  It  is  seen  that  this  adaptive 
scheme  performs  considerably  better  than  the  non-adaptlve  scheme.  'Ilia  hardw.iro 
Involved  in  iirpleraenting  this  .scheme  is  rather  minimal  e.g, 

(1)  for  estimating  the  variance,  a divide  by  a multiple  of  two  cun  be  iinplomontod 
by  a .shift  register. 

(1)  Normalization  cf  Coefficient. 

(3)  DPCM  encoders  for  the  estimates. 

In  view  of  the  results  obtained  to  present,  it  is  recommended  that  additional 
effort  be  expended  to  optimize  the  systems  described  above.  One  other  improvement: 
wiiich  should  be  Invpstigated  is  the  elimiiMtlon  of  the  necossltv  of  transmitting 
the  estimates  of  the  variances.  Tills  could  be  accomplished  by  having  a predetermined 
algorithm  which  by  looking  at  nhe  bit  stream  for  each  of  the  coefficients  we  could 
adjust  the  quantizer  in  some  predetermined  manner.  'ITie  receiver  could  then  use  the 
jame  rulr:  U'  adj.,  t its  quiiiitlzers  tiuis  el  i":ln- ’ iiig  the  need  foi  trr,iiMiii  it  iiig 
Information  about  ihe  estimates  of  the  variance,  Such  companding  rules  (for  example 
tl,e  7-7-<l-.i  aile)  have  been  used  successfully  in  designing  adaptive  systems  for 
sper  , Signals.  In  .adJitlo’i  the  adaptive  procedures  described  here  could  be  used  on 
the  Hybrid  coding  techniques. 

‘in  invu.iiig.atlon  of  this  tyiie  enn  readily  be  performed  by  computer  search 
tS'chniquBS . 
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CHAPTER  VI 


CONCLUSIONS  AND  RECOMMENDATIONS 

The  franc-to-frsme  reduction  techniques  described  in  Chspter  II  do  not  seem 
at  the  present  time  to  bo  applicable  to  the  RPV  mission  due  to  the  complexity  of 
implementation  and  the  large  amount  of  storage  required.  In  order  to  obtain 
large  bit  reduction  ratios,  it  is  necessary  to  be  able  to  predict  the  movement 
of  picture  elements  from  one  frame  to  another.  This  requires  that  relative  aecu* 
rate  knowledge  about  such  parameters  as: 

(1)  Vertical  and  horizontal  fields  of  vision 

(2)  The  velocity  vector 

C3}  TTie  altitude 

(4)  Optical  parameters  such  as  focal  length,  etc. 

(5)  Depression  angles 

(6}  Prame  rate 

(7)  Dimensions  of  the  frame 

If  the  parameters  noted  above  are  known,  large  bit  reductions  are  possible, 
even  though  it  if  required  that  synchronization  information  be  transmitted  along 
with  each  sample,  The  system  was  analyzed  in  Chapter  II  using  simulated  pictures 
and  the  results  are  presented  there.  Sensitivity  '.o  the  accuracy  of  the  parameters 
given  above  are  included.  Real  pictures  could  not  be  used  In  the  simulation  due 
to  the  lack  of  consistent  data  from  frame-to*frome. 

Tl-ie  frame-to- frame  techniques  described  In  Chapter  II  would  be  useful  and 
practical  for  synthetic  frame  generation  at  the  remote  ground  station.  This 
would  enable  the  use  of  relatively  slow  frame  rates  and  using  the  algorithms 
given,  one  could  easily  generate  synthetic  frames  for  insertion  at  the  ground 


station.  This  would  ollminate  some  of  the  psychophysical  effects  of  using  slow 
frame  rates. 

Chapter  III  gives  theoretical  results  using  two-dimensional  transform  tech- 
niques and  Hybrid  coding  techniques.  For  the  Hybrid  coding  schemes  both  the 
Trans form-DPCM  and  UPCM-Transform  techniques  are  considered.  It  is  shown  that 
both  systems  have  e.tactly  equivalent  performances;  hencsi  due  to  the  simplicity 
of  the  Trans form-DPCM  it  is  preferred. 

The  order  of  implementation  complexities  of  the  two-dimensional  transform 
techniques  end  also  their  order  of  performances  are: 

(1 ) Karhunan  Lobve 

(2)  Discrete  Cosine 

(3)  Fourier 

(4)  Hadamard 

(5)  Haar 

Due  to  Implementation  simplicities  the  Hadamard  or  the  Hear  transforms  are 
generally  prei'erred  for  practical  systems.  These  two-dimensional  schemes  are 
generally  performed  using  two  one-dimensional  transforms.  One  in  the  horlsontal 
direction  to  rtimovc  ttic  cuirelstion  in  tlia*  sputisl  diTccllon  and  then  one  in 
the  vertical  direction  to  remove  the  correlation  in  that  spatial  direction. 
Although  thooretlcally  the  removel  of  the  correlation  in  one  spatial  direction 
does  not  affect  che  correlation  in  the  other,  for  real  data,  such  as  vhe  pictures 
used  in  this  investigation,  this  is  shown  not  be  the  case, 

It  is  shown  that  the  Hybrid  coding  schemes  perform  better  then  roost  two- 
dimensional  transform  techniques,  being  almost  equal  in  performance  to  the  two- 
dimensional  Karhunen  Lobve  transform  techniques.  The  sensitivity  to  the 
prediction  coefficients  In  the  DPCM  encoders  are  shown  to  be  minimal. 
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The  effects  of  channel  noise  un  the  Hybrid  coding  schemes  nro  shown  to  be  consldernhly 
more  degrodlnti  iisinc  theio  schemes  than  on  the  two-dimensional  transform  schemas. 

However,  hy  optimisation  of  the  Hybrid  coding  schemes  snd  by  periodic  initialisation 
the  sensitivity  to  noise  enn  be  grcotly  redu.iod. 

Several  different  error  criteria  wero  investigated  to  see  If  some  type  of  quanti- 
tative tnensuros  could  be  obtained  wnlch  would  correlate  well  with  subjective  ovuluntlons. 
Those  investigated  were: 

0)  Normtlised-mean-squared-error  (MSB) 

(S)  Normalised-derivativo-squared-error  (NOSE) 

(3)  Normalized-mean-absolute  error  (MAE) 

Results  indicate  that  the  MSB  measure  give.s  good  correlation  when  one  roitricti  the 
rvaluatlons  to  the  some  picture  and  to  the  same  processing  techniques.  Utls  measure 
o.iii  be  used  effectively  for  determining  the  effecti  of  lowering  tho  bit  rate,  noire, 
etc.  when  comparing  the  .<ame  procosslng  techniques.  'Hie  NDSE  measure  anpears  to  be 
more  correlated  with  subjective  evaluations,  as  far  as  tho  resolution  obtained  is 
concerned 

An  adaptive  schema  for  the  two-dimensional  lladamard  transform  technique  was 
proposed  luid  InvosiigatiM  which  gives  e.oi.-'ildei  iibly  botter  j'osull.s  than  fixed  two- 
dimensional  transforms,  this  technique  is  slightly  more  compile;  however,  the  Improve- 
ments may  well  be  worth  this  Increased  complexity. 

Numerous  pictures  using  the  techniques  described  above  nro  given  in  Chapters 
IV  and  V. 

Table  6 summarizes  the  Important  average  characteristics  of  the  techniques  studied 
in  this  investigation  along  with  several  results  taken  from  the  literature.  These 
methods  are  thought  to  be  the  most  appllcnhU-  to  the  RI’V. 

!t  is  recohimendeU  that  further  study  be  performed  on  the  adaptive  algorithm 


pro»entod  in  Cliuplor  V.  In  porticulbi  nn  udnpt;ation  nlKoritlMn  DhoutJ  be  determined 
witich  requiroi  the  tranamiHaion  of  no  additional  information.  .Suoh  a nyatetn  slio\ild 
not  b«  much  more  complex  thnu  tho  cotiventiopnl  twu>dimoiviiunnl  irnnafnrmntiona  or 
Hybrid  codlnjj  tochnlquea.  Tlie  u»c  of  error  correcting  coding  fop  both  typea  of  ayatoma 
(Trahaform  and  Hybrid]  ahould  be  investigated  along  with  channol  charactoriatica  and 
Lranamiasion  modems.  The  effects  of  finite  word  lengtha  uaed  on  a practical  syatem 
ahould  ba  conaiderod  with  ragarda  to  the  aenaitlvlr>'  of  the  proceaaing  tachniquei. 
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